usatkd.org
robots.txt

Robots Exclusion Standard data for usatkd.org

Resource Scan

Scan Details

Site Domain usatkd.org
Base Domain usatkd.org
Scan Status Ok
Last Scan2025-09-13T12:37:29+00:00
Next Scan 2025-10-13T12:37:29+00:00

Last Scan

Scanned2025-09-13T12:37:29+00:00
URL https://usatkd.org/robots.txt
Redirect https://www.usatkd.org/robots.txt
Redirect Domain www.usatkd.org
Redirect Base usatkd.org
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 146.75.46.133
Found Yes
Hash a95970ee23711eb4fa49a63e61c4f42ce93fd64a52a8d294635ba5a7bd3266d7
SimHash 4a3d54d1e780

Groups

googlebot

Rule Path
Disallow /nogooglebot/
Disallow /api/orangeIsTheNewBanana

meta-externalagent

Rule Path
Disallow /

applebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /api/orangeIsTheNewBanana

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Disallow /

yandexrenderresourcesbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

onetrustbot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /api/orangeIsTheNewBanana

Other Records

Field Value
sitemap https://www.usatkd.org/sitemap.xml
sitemap https://www.usatkd.org/video_sitemap.xml