maturetenders.com
robots.txt
Robots Exclusion Standard data for maturetenders.com
Resource Scan
Scan Details
Site Domain | maturetenders.com |
Base Domain | maturetenders.com |
Scan Status | Ok |
Last Scan | 2024-10-30T18:23:45+00:00 |
Next Scan | 2024-11-29T18:23:45+00:00 |
Last Scan
Scanned | 2024-10-30T18:23:45+00:00 |
URL | https://maturetenders.com/robots.txt |
Redirect | https://www.maturetenders.com/robots.txt |
Redirect Domain | www.maturetenders.com |
Redirect Base | maturetenders.com |
Domain IPs | 138.197.199.156, 165.227.103.227 |
Redirect IPs | 23.215.7.12, 23.215.7.19, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:713 |
Response IP | 23.215.7.12 |
Found | Yes |
Hash | df084abb02d7cfe710d287947cf1c8bf1f097a33ecf6548d928e96ec8b78150d |
SimHash | 68554840cf73 |
Groups
*
Rule | Path |
---|---|
Disallow | *autologin* |
*
Rule | Path |
---|---|
Disallow | /landing/mta |
Disallow | /t/tr |
Other Records
Field | Value |
---|---|
sitemap | https://www.maturetenders.com/sitemap.xml |