collectorcarnation.com
robots.txt

Robots Exclusion Standard data for collectorcarnation.com

Resource Scan

Scan Details

Site Domain collectorcarnation.com
Base Domain collectorcarnation.com
Scan Status Ok
Last Scan2024-09-20T02:57:31+00:00
Next Scan 2024-09-27T02:57:31+00:00

Last Scan

Scanned2024-09-20T02:57:31+00:00
URL https://collectorcarnation.com/robots.txt
Redirect https://www.collectorcarnation.com/robots.txt
Redirect Domain www.collectorcarnation.com
Redirect Base collectorcarnation.com
Domain IPs 104.21.0.117, 172.67.150.237, 2606:4700:3037::6815:75, 2606:4700:3037::ac43:96ed
Redirect IPs 104.21.0.117, 172.67.150.237, 2606:4700:3037::6815:75, 2606:4700:3037::ac43:96ed
Response IP 104.21.0.117
Found Yes
Hash 2980144db683f3cc895d335c948b000fe473029d4f099055646e7c988f802263
SimHash 6854fad02a93

Groups

*

Rule Path
Disallow /2922/RacingJunk/
Disallow /forums/search.php
Disallow /forums/members/
Disallow /forums/memberlist.php
Disallow /forums/tags.php
Disallow /search

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Disallow /2922/RacingJunk/
Disallow /forums/search.php
Disallow /forums/members/
Disallow /forums/members/list/
Disallow /forums/tags.php

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.racingjunk.com/sitemaps/sitemap-index.xml