thegotomarketcompany.com
robots.txt

Robots Exclusion Standard data for thegotomarketcompany.com

Resource Scan

Scan Details

Site Domain thegotomarketcompany.com
Base Domain thegotomarketcompany.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-31T02:33:53+00:00
Next Scan 2024-10-29T02:33:53+00:00

Last Successful Scan

Scanned2023-06-15T02:21:05+00:00
URL https://thegotomarketcompany.com/robots.txt
Domain IPs 94.177.162.243
Response IP 94.177.162.243
Found Yes
Hash 043a1aa719bec3b3db63d7a5f0976f4aa157860489a83a7dcb0b4f8181d7dd07
SimHash 6d7d4bf6f691

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /logs/
Disallow /plesk-stat/
Disallow /processing/
Disallow /tmp/
Disallow /cookies
Disallow /panel
Disallow /238dGh48ycc-3892dXckhQu

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.thegotomarketcompany.com/sitemap.xml