maturetenders.com
robots.txt

Robots Exclusion Standard data for maturetenders.com

Resource Scan

Scan Details

Site Domain maturetenders.com
Base Domain maturetenders.com
Scan Status Ok
Last Scan2024-10-30T18:23:45+00:00
Next Scan 2024-11-29T18:23:45+00:00

Last Scan

Scanned2024-10-30T18:23:45+00:00
URL https://maturetenders.com/robots.txt
Redirect https://www.maturetenders.com/robots.txt
Redirect Domain www.maturetenders.com
Redirect Base maturetenders.com
Domain IPs 138.197.199.156, 165.227.103.227
Redirect IPs 23.215.7.12, 23.215.7.19, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:713
Response IP 23.215.7.12
Found Yes
Hash df084abb02d7cfe710d287947cf1c8bf1f097a33ecf6548d928e96ec8b78150d
SimHash 68554840cf73

Groups

*

Rule Path
Disallow *autologin*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.maturetenders.com/sitemap.xml