dragstuff.com
robots.txt

Robots Exclusion Standard data for dragstuff.com

Resource Scan

Scan Details

Site Domain dragstuff.com
Base Domain dragstuff.com
Scan Status Ok
Last Scan2025-11-10T22:25:25+00:00
Next Scan 2025-11-17T22:25:25+00:00

Last Scan

Scanned2025-11-10T22:25:25+00:00
URL https://dragstuff.com/robots.txt
Redirect https://www.dragstuff.com/robots.txt
Redirect Domain www.dragstuff.com
Redirect Base dragstuff.com
Domain IPs 216.146.219.232
Redirect IPs 216.146.219.232
Response IP 216.146.219.232
Found Yes
Hash d3d7697eb7b512c82309072dc67c5332a9940345e383f52dbe23c6ce10d5bcbf
SimHash d014fa82e212

Groups

chatgptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

oai-searchbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /forum/profile.php
Disallow /forum/download/
Disallow /forum/faq.php
Disallow /forum/memberlist.php
Disallow /opnx/

sbider
coccocbot-web
censysinspect
yandex
moget
ichiro
dotbot
amazonbot
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
semrushbot
amazonbot
blexbot
bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.dragstuff.com/sitemap.xml
sitemap http://www.dragstuff.com/video-sitemap.xml

Warnings

  • 1 invalid line.