Log In Sign Up

dubaisports.ae
robots.txt

Robots Exclusion Standard data for dubaisports.ae

Resource Scan

Scan Details

Site Domain dubaisports.ae
Base Domain dubaisports.ae
Scan Status Ok
Last Scan2024-07-01T20:33:28+00:00
Next Scan 2024-07-08T20:33:28+00:00

Last Scan

Scanned2024-07-01T20:33:28+00:00
URL https://dubaisports.ae/robots.txt
Redirect https://www.dubaisports.ae/content/dubaisports/robots.txt
Redirect Domain www.dubaisports.ae
Redirect Base dubaisports.ae
Domain IPs 3.250.251.107
Redirect IPs 13.33.88.119, 13.33.88.5, 13.33.88.82, 13.33.88.90, 2600:9000:223b:200:6:1394:d3c0:93a1, 2600:9000:223b:3400:6:1394:d3c0:93a1, 2600:9000:223b:3800:6:1394:d3c0:93a1, 2600:9000:223b:7200:6:1394:d3c0:93a1, 2600:9000:223b:9800:6:1394:d3c0:93a1, 2600:9000:223b:a00:6:1394:d3c0:93a1, 2600:9000:223b:ac00:6:1394:d3c0:93a1, 2600:9000:223b:e800:6:1394:d3c0:93a1
Response IP 13.33.88.119
Found Yes
Hash 72252cd58374b95ed735e797145d8c197536b088db8e90e4ae87b94d8fcd8337
SimHash 9e853f0ccbfb

Groups

*

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/
Disallow /content/dubaisports/ArticlePool/
Disallow /content/dubaisports/photos/
Disallow /content/dubaisports/videos/
Disallow /content/dubaisports/infographics/
Disallow /content/dubaisports/reset/
Disallow /content/dubaisports/search/
Disallow /content/sports-api/
Disallow /services/
Disallow /football/
Disallow /other-sports/
Disallow /mobile/
Disallow /content/dubaisports/content/dubaisports/
Disallow /bin/
Disallow /content/dubaisports/player
Disallow /content/dubaisports/top-scorer
Disallow /content/dubaisports/admin-page
Disallow /content/dubaisports/football/schedule
Disallow /content/dubaisports/football/standing
Disallow /content/dubaisports/football/top-scorer
Disallow /content/dubaisports/football/team
Disallow /content/dubaisports/football/players
Back to top

Other Records

Field Value
sitemap http://www.dubaisports.ae/content/common/sitemap.dubaisports.xml
Back to top