frameworkit.com
robots.txt

Robots Exclusion Standard data for frameworkit.com

Resource Scan

Scan Details

Site Domain frameworkit.com
Base Domain frameworkit.com
Scan Status Ok
Last Scan2025-11-09T02:13:50+00:00
Next Scan 2025-12-09T02:13:50+00:00

Last Scan

Scanned2025-11-09T02:13:50+00:00
URL https://frameworkit.com/robots.txt
Redirect https://www.frameworkit.com/robots.txt
Redirect Domain www.frameworkit.com
Redirect Base frameworkit.com
Domain IPs 75.2.32.4
Redirect IPs 75.2.32.4
Response IP 75.2.32.4
Found Yes
Hash c0a4ddfd68c08aab74f0fb89e0ae4f00bb71f5f7451b6106e9644213b060be95
SimHash 63059450c735

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.frameworkit.com/sitemap.xml