techstumped.com
robots.txt

Robots Exclusion Standard data for techstumped.com

Resource Scan

Scan Details

Site Domain techstumped.com
Base Domain techstumped.com
Scan Status Ok
Last Scan2025-10-28T03:17:31+00:00
Next Scan 2025-11-04T03:17:31+00:00

Last Scan

Scanned2025-10-28T03:17:31+00:00
URL https://techstumped.com/robots.txt
Redirect https://www.techstumped.com/robots.txt
Redirect Domain www.techstumped.com
Redirect Base techstumped.com
Domain IPs 104.21.9.132, 172.67.160.12, 2606:4700:3031::6815:984, 2606:4700:3036::ac43:a00c
Redirect IPs 104.21.9.132, 172.67.160.12, 2606:4700:3031::6815:984, 2606:4700:3036::ac43:a00c
Response IP 104.21.9.132
Found Yes
Hash e5044a04669ac83f28d40564e634c6f0299e5c4a242321eeb810ead3cda613f5
SimHash 6120df30c073

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.techstumped.com/sitemap_index.xml

Comments

  • block some AI chat bot crawlers