insidethemagic.com
robots.txt

Robots Exclusion Standard data for insidethemagic.com

Resource Scan

Scan Details

Site Domain insidethemagic.com
Base Domain insidethemagic.com
Scan Status Ok
Last Scan2024-06-27T18:15:59+00:00
Next Scan 2024-07-04T18:15:59+00:00

Last Scan

Scanned2024-06-27T18:15:59+00:00
URL https://insidethemagic.com/robots.txt
Redirect https://insidethemagic.net/robots.txt
Redirect Domain insidethemagic.net
Redirect Base insidethemagic.net
Domain IPs 104.21.38.74, 172.67.220.19, 2606:4700:3031::6815:264a, 2606:4700:3031::ac43:dc13
Redirect IPs 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c
Response IP 104.16.150.108
Found Yes
Hash 305b2e519947f9e3e067baaae80d1e4bc39c02237be2f2f47fa28da5afa94b05
SimHash 61289a62c3b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cdn-cgi/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://insidethemagic.net/sitemap_index.xml