geeksvgs.com
robots.txt

Robots Exclusion Standard data for geeksvgs.com

Resource Scan

Scan Details

Site Domain geeksvgs.com
Base Domain geeksvgs.com
Scan Status Ok
Last Scan2025-09-15T02:14:31+00:00
Next Scan 2025-09-22T02:14:31+00:00

Last Scan

Scanned2025-09-15T02:14:31+00:00
URL https://geeksvgs.com/robots.txt
Domain IPs 104.21.54.63, 172.67.136.8, 2606:4700:3033::ac43:8808, 2606:4700:3037::6815:363f
Response IP 104.21.54.63
Found Yes
Hash 4d462b807e7c960c5dc01a4375c04a194eb066c82353b15af824bb945ddf317f
SimHash 3d1ebd83f85a

Groups

*

Rule Path
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 60

amazonbot

Rule Path
Disallow /
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 600

ahrefsbot

Rule Path
Disallow /
Disallow /Report.php*
Disallow /files/*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 60

mj12bot

Rule Path
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 600

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

msnbot/2.0b

Rule Path
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 10

claudebot

Rule Path
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 60

gptbot

Rule Path
Disallow /Report.php*
Disallow /download.php*
Disallow /out.php*

Other Records

Field Value
crawl-delay 60

hyscore

Rule Path
Disallow /

domaincrawler/3.0

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

Comments

  • abusive crawler doesnt even read this file but if it does then maybe it will listen lol