wsieci24.pl
robots.txt

Robots Exclusion Standard data for wsieci24.pl

Resource Scan

Scan Details

Site Domain wsieci24.pl
Base Domain wsieci24.pl
Scan Status Ok
Last Scan2024-09-27T07:27:52+00:00
Next Scan 2024-10-04T07:27:52+00:00

Last Scan

Scanned2024-09-27T07:27:52+00:00
URL https://wsieci24.pl/robots.txt
Domain IPs 51.77.49.78
Response IP 51.77.49.78
Found Yes
Hash c65fcb016e8a4b9ed967eb5ca2ac02edee0b5e1c33e1d4b7abc7041349ec9543
SimHash 60208a0a0f32

Groups

scrapy

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /xmlrpc.php
Disallow /wp-includes/wlwmanifest.xml

Warnings

  • `ser-agent` is not a known field.