socialwelfare.library.vcu.edu
robots.txt

Robots Exclusion Standard data for socialwelfare.library.vcu.edu

Resource Scan

Scan Details

Site Domain socialwelfare.library.vcu.edu
Base Domain vcu.edu
Scan Status Ok
Last Scan2024-10-26T19:51:45+00:00
Next Scan 2024-11-25T19:51:45+00:00

Last Scan

Scanned2024-10-26T19:51:45+00:00
URL https://socialwelfare.library.vcu.edu/robots.txt
Domain IPs 34.73.119.133
Response IP 34.73.119.133
Found Yes
Hash 4be5c9591002db81b74bbe4f7b7289b8cb9d0bcbfead9ae84a8b425b9b3af090
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10