mt.nl
robots.txt

Robots Exclusion Standard data for mt.nl

Resource Scan

Scan Details

Site Domain mt.nl
Base Domain mt.nl
Scan Status Ok
Last Scan2024-06-10T20:56:22+00:00
Next Scan 2024-06-17T20:56:22+00:00

Last Scan

Scanned2024-06-10T20:56:22+00:00
URL https://mt.nl/robots.txt
Redirect https://mtsprout.nl/robots.txt
Redirect Domain mtsprout.nl
Redirect Base mtsprout.nl
Domain IPs 178.22.62.73, 2a00:1e28:3:a035::1
Redirect IPs 104.26.2.63, 104.26.3.63, 172.67.74.173, 2606:4700:20::681a:23f, 2606:4700:20::681a:33f, 2606:4700:20::ac43:4aad
Response IP 104.26.3.63
Found Yes
Hash 31b1f961905558fdd6c1543d8f38f2cd4ab2dd1da0e39fe650f185b834077816
SimHash 4100dc0283a3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /search/
Disallow *?
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10