psvidler.net
robots.txt

Robots Exclusion Standard data for psvidler.net

Resource Scan

Scan Details

Site Domain psvidler.net
Base Domain psvidler.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-12T18:43:14+00:00
Next Scan 2025-12-11T18:43:14+00:00

Last Successful Scan

Scanned2023-10-31T18:36:37+00:00
URL https://psvidler.net/robots.txt
Domain IPs 104.21.37.204, 172.67.212.230, 2606:4700:3031::6815:25cc, 2606:4700:3037::ac43:d4e6
Response IP 172.67.212.230
Found Yes
Hash 0af65899f89b5145472953029d7d3911b71f96917e2ceca603fa778b0928b82f
SimHash 881d8050c211

Groups

ahrefsbot
mj12bot
rogerbot
backlinkcrawler
semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Allow /*.js$
Allow /*.css$

Warnings

  • `https` is not a known field.