re-integration.com
robots.txt

Robots Exclusion Standard data for re-integration.com

Resource Scan

Scan Details

Site Domain re-integration.com
Base Domain re-integration.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T16:31:43+00:00
Next Scan 2025-12-21T16:31:43+00:00

Last Successful Scan

Scanned2025-10-22T08:39:16+00:00
URL https://re-integration.com/robots.txt
Redirect https://re-integration.weebly.com/robots.txt
Redirect Domain re-integration.weebly.com
Redirect Base weebly.com
Domain IPs 2a02:4780:84:1dd4:1a9a:cfc7:384b:7874, 2a02:4780:84:d5cc:74a5:d488:c002:739f, 84.32.84.21, 84.32.84.54
Redirect IPs 74.115.51.8, 74.115.51.9
Response IP 74.115.51.9
Found Yes
Hash 381474c2d528d09e7d1edca1b01a30750f84c1a14a1c77e526e7f18d72e112cf
SimHash 495ddc722ed2

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//www.amazon.com/dp/B01N6UDTL8
Disallow /https%3A//www.amazon.com/dp/B01MZD8THO
Disallow /https%3A//www.amazon.com/dp/B01N6UDTL8
Disallow /https%3A//www.amazon.com/dp/B01MZD8WMD
Disallow /life-coaching.html
Disallow /about.html

Other Records

Field Value
sitemap https://re-integration.weebly.com/sitemap.xml