themeinprogress.com
robots.txt

Robots Exclusion Standard data for themeinprogress.com

Resource Scan

Scan Details

Site Domain themeinprogress.com
Base Domain themeinprogress.com
Scan Status Ok
Last Scan2025-03-09T11:51:11+00:00
Next Scan 2025-04-08T11:51:11+00:00

Last Scan

Scanned2025-03-09T11:51:11+00:00
URL https://themeinprogress.com/robots.txt
Domain IPs 2a02:4780:84:bf1e:30b5:328d:3ab:859, 84.32.84.42
Response IP 179.61.189.111
Found Yes
Hash 6ba0220f4ca89a8954ea85cddfce8c3e210b130ab7eebf750501d20f906efadb
SimHash c20c4844aa13

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /voobis/
Disallow /thank-you-for-your-purchase/
Disallow /checkout.php

eyemonit_bot_version_0.1_(http://www.eyemon.it/)

Rule Path
Disallow /

eyemonit_bot_version_0.1_

Rule Path
Disallow /

eyemonit_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baidu spider

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.themeinprogress.com/sitemap.xml.gz