heroesofdigital.com
robots.txt

Robots Exclusion Standard data for heroesofdigital.com

Resource Scan

Scan Details

Site Domain heroesofdigital.com
Base Domain heroesofdigital.com
Scan Status Ok
Last Scan2025-11-04T15:29:47+00:00
Next Scan 2025-12-04T15:29:47+00:00

Last Scan

Scanned2025-11-04T15:29:47+00:00
URL https://heroesofdigital.com/robots.txt
Domain IPs 104.21.54.104, 172.67.168.113, 2606:4700:3032::6815:3668, 2606:4700:3032::ac43:a871
Response IP 104.21.54.104
Found Yes
Hash 76af7b20133fd9ba93a39694413c37c23811585485a40aeb235a014e4cfe35fc
SimHash 41005d524f91

Groups

*

Rule Path
Allow /
Disallow /copywriting-inspiration/page/4/
Disallow /copywriting-inspiration/page/6/
Disallow /copywriting-inspiration/page/5/
Disallow /copywriting-inspiration/page/3/
Disallow /copywriting-inspiration/page/2/
Disallow /my/copywriting-inspiration/page/4/
Disallow /my/copywriting-inspiration/page/6/
Disallow /my/copywriting-inspiration/page/5/
Disallow /my/copywriting-inspiration/page/3/
Disallow /my/copywriting-inspiration/page/2/
Disallow /case-studies-pdf/

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.heroesofdigital.com/sitemap_index.xml