Log In Sign Up

digitalforge.io
robots.txt

Robots Exclusion Standard data for digitalforge.io

Resource Scan

Scan Details

Site Domain digitalforge.io
Base Domain digitalforge.io
Scan Status Ok
Last Scan2025-07-14T07:07:47+00:00
Next Scan 2025-08-13T07:07:47+00:00

Last Scan

Scanned2025-07-14T07:07:47+00:00
URL http://digitalforge.io/robots.txt
Domain IPs 149.126.4.103, 2a01:ab20:0:4::103
Response IP 149.126.4.103
Found Yes
Hash e34c420cf7ab7cb8aecf8d41bcda5ea2925b0e3e9ac13c1361257c395b050fe7
SimHash 6a54dc562793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Back to top

Other Records

Field Value
sitemap http://digitalforge.io/sitemap.xml
Back to top