ift.org
robots.txt

Robots Exclusion Standard data for ift.org

Resource Scan

Scan Details

Site Domain ift.org
Base Domain ift.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-21T08:36:45+00:00
Next Scan 2025-01-19T08:36:45+00:00

Last Successful Scan

Scanned2022-12-06T23:00:25+00:00
URL https://ift.org/robots.txt
Domain IPs 20.49.97.3
Response IP 20.49.97.3
Found Yes
Hash 9e56082a3f5b3459cb5e9b33695d63c8c38b41493dc2f6fde712d172d81ab6ce
SimHash ec585cb08f32

Groups

swiftbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

discobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /sitecore
Disallow /sitecore_modules
Disallow /sitecore_files
Disallow /temp
Disallow /ift/home

Other Records

Field Value
sitemap https://www.ift.org/sitemap.xml

Warnings

  • 2 invalid lines.