urduupdates.com
robots.txt

Robots Exclusion Standard data for urduupdates.com

Resource Scan

Scan Details

Site Domain urduupdates.com
Base Domain urduupdates.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-02T21:02:06+00:00
Next Scan 2024-12-31T21:02:06+00:00

Last Successful Scan

Scanned2023-06-07T13:03:30+00:00
URL https://urduupdates.com/robots.txt
Domain IPs 104.21.49.233, 172.67.195.144, 2606:4700:3030::ac43:c390, 2606:4700:3033::6815:31e9
Response IP 104.21.49.233
Found Yes
Hash dbab3b4958897663eb59eb32e2ac9912f31ac7d1a3de818ebbb68509eddaaf86
SimHash 61014baefab2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /linkout/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://urduupdates.com/sitemap.xml