mnet.mk
robots.txt

Robots Exclusion Standard data for mnet.mk

Resource Scan

Scan Details

Site Domain mnet.mk
Base Domain mnet.mk
Scan Status Ok
Last Scan2024-10-01T18:56:16+00:00
Next Scan 2024-10-08T18:56:16+00:00

Last Scan

Scanned2024-10-01T18:56:16+00:00
URL https://mnet.mk/robots.txt
Domain IPs 104.21.234.124, 104.21.234.125, 2606:4700:3038::6815:ea7c, 2606:4700:3038::6815:ea7d
Response IP 104.21.234.125
Found Yes
Hash c04ed1278ad29b09120a01c682acd5743650e5256164b2672f96773c39640eb5
SimHash 4d08dc94ebd5

Groups

*

Rule Path
Disallow /category/

Other Records

Field Value
crawl-delay 5000