digitalreborn.com
robots.txt

Robots Exclusion Standard data for digitalreborn.com

Resource Scan

Scan Details

Site Domain digitalreborn.com
Base Domain digitalreborn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-11T02:19:20+00:00
Next Scan 2024-11-10T02:19:20+00:00

Last Successful Scan

Scanned2024-07-14T02:16:27+00:00
URL https://digitalreborn.com/robots.txt
Domain IPs 104.21.6.238, 172.67.135.119, 2606:4700:3037::6815:6ee, 2606:4700:3037::ac43:8777
Response IP 104.21.6.238
Found Yes
Hash e42772ff035f9d8c3d062ea6274e1020198991a28eff8c4d01a43cb93381c04b
SimHash 42351a22a193

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cdn-cgi/
Disallow /porpoiseant/
Disallow /tardisrocinante/
Disallow /detroitchicago/
Disallow /ezoic/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.digitalreborn.com/sitemap_index.xml