netgainnetworks.com
robots.txt

Robots Exclusion Standard data for netgainnetworks.com

Resource Scan

Scan Details

Site Domain netgainnetworks.com
Base Domain netgainnetworks.com
Scan Status Ok
Last Scan2026-02-15T01:21:03+00:00
Next Scan 2026-03-17T01:21:03+00:00

Last Scan

Scanned2026-02-15T01:21:03+00:00
URL https://netgainnetworks.com/robots.txt
Domain IPs 138.197.53.139
Response IP 138.197.53.139
Found Yes
Hash 1ddc1eedee553df28e6746b8d5c2b6d542a0ef63ac0d94f2f4509791f4c93e0a
SimHash d4048d380feb

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /events/action~posterboard/
Disallow /events/action~agenda/
Disallow /events/action~oneday/
Disallow /events/action~month/
Disallow /events/action~week/
Disallow /events/action~stream/
Disallow /events/action~undefined/
Disallow /events/action~http%3A/
Disallow /events/action~default/
Disallow /events/action~poster/
Disallow /events/action~*/