antydziad.salon24.pl
robots.txt

Robots Exclusion Standard data for antydziad.salon24.pl

Resource Scan

Scan Details

Site Domain antydziad.salon24.pl
Base Domain salon24.pl
Scan Status Ok
Last Scan2024-05-25T09:59:34+00:00
Next Scan 2024-06-24T09:59:34+00:00

Last Scan

Scanned2024-05-25T09:59:34+00:00
URL https://antydziad.salon24.pl/robots.txt
Domain IPs 51.254.41.56
Response IP 51.254.41.56
Found Yes
Hash 945a4e13fcb10d01f6abac0245efde5341e2a1ddf726fbd3d4df2c7152e6d421
SimHash 6304d872c331

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Allow /
Disallow /*-json/
Disallow /abuse-save/
Disallow /service-search/

Other Records

Field Value
crawl-delay 5