govtexamupdate.com
robots.txt

Robots Exclusion Standard data for govtexamupdate.com

Resource Scan

Scan Details

Site Domain govtexamupdate.com
Base Domain govtexamupdate.com
Scan Status Ok
Last Scan2025-10-01T21:26:19+00:00
Next Scan 2025-10-08T21:26:19+00:00

Last Scan

Scanned2025-10-01T21:26:19+00:00
URL https://govtexamupdate.com/robots.txt
Domain IPs 160.153.0.69
Response IP 160.153.0.69
Found Yes
Hash 68eb47abee8e9e200bcb3d7ea7f1c0233f45fc6f187fdf2de73bfafa58f2f1a1
SimHash 554c9b0025b0

Groups

mediapartners-google
*

Rule Path
Allow /

botpoke

Rule Path
Disallow /

evilbot

Rule Path
Disallow /

badcrawler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /