jetpunk.com
robots.txt

Robots Exclusion Standard data for jetpunk.com

Resource Scan

Scan Details

Site Domain jetpunk.com
Base Domain jetpunk.com
Scan Status Ok
Last Scan2024-10-05T08:32:35+00:00
Next Scan 2024-10-12T08:32:35+00:00

Last Scan

Scanned2024-10-05T08:32:35+00:00
URL https://jetpunk.com/robots.txt
Redirect https://www.jetpunk.com/robots.txt
Redirect Domain www.jetpunk.com
Redirect Base jetpunk.com
Domain IPs 104.21.23.234, 172.67.214.36, 2606:4700:3030::ac43:d624, 2606:4700:3037::6815:17ea
Redirect IPs 104.21.23.234, 172.67.214.36, 2606:4700:3030::ac43:d624, 2606:4700:3037::6815:17ea
Response IP 104.21.23.234
Found Yes
Hash b62bd982f1f86a9bb0300a39f0c350496565b61361ded1c682afa5dff1637508
SimHash 50175042e890

Groups

*

Rule Path
Disallow /admin/

amazonbot
claudebot
bytespider
seekportbot
ahrefsbot
mj12bot
petalbot
semrushbot
mauibot
dataforseobot
blexbot
imagesiftbot
barkrowler
moget
ichiro
naverbot
yeti
sogou spider
youdaobot
yandexbot
friendlycrawler
turnitin
dotbot
jaunt
verity
gptbot
serpstatbot

Rule Path
Disallow /