agsep.eu
robots.txt

Robots Exclusion Standard data for agsep.eu

Resource Scan

Scan Details

Site Domain agsep.eu
Base Domain agsep.eu
Scan Status Ok
Last Scan2025-09-24T12:20:30+00:00
Next Scan 2025-10-24T12:20:30+00:00

Last Scan

Scanned2025-09-24T12:20:30+00:00
URL https://agsep.eu/robots.txt
Domain IPs 2001:41d0:301:11::30, 94.23.73.16
Response IP 94.23.73.16
Found Yes
Hash 254f16445b4cdd484b7ffc707199ea9bcef6c8fdfd002c79b4185e511e15cc5a
SimHash 6aa6dd332b52

Groups

bingbot

Rule Path
Disallow /?s=
Disallow /search/

Other Records

Field Value
crawl-delay 10

google
*

Rule Path
Disallow /
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /about/action~posterboard/
Disallow /about/action~agenda/
Disallow /about/action~oneday/
Disallow /about/action~month/
Disallow /about/action~week/
Disallow /about/action~stream/
Disallow /about/action~undefined/
Disallow /about/action~http%3A/
Disallow /about/action~default/
Disallow /about/action~poster/
Disallow /about/action~*/