usatranslate.com
robots.txt

Robots Exclusion Standard data for usatranslate.com

Resource Scan

Scan Details

Site Domain usatranslate.com
Base Domain usatranslate.com
Scan Status Ok
Last Scan2024-05-11T21:50:59+00:00
Next Scan 2024-06-10T21:50:59+00:00

Last Scan

Scanned2024-05-11T21:50:59+00:00
URL https://usatranslate.com/robots.txt
Redirect https://www.usatranslate.com/robots.txt
Redirect Domain www.usatranslate.com
Redirect Base usatranslate.com
Domain IPs 104.26.12.50, 104.26.13.50, 172.67.73.8, 2606:4700:20::681a:c32, 2606:4700:20::681a:d32, 2606:4700:20::ac43:4908
Redirect IPs 104.26.12.50, 104.26.13.50, 172.67.73.8, 2606:4700:20::681a:c32, 2606:4700:20::681a:d32, 2606:4700:20::ac43:4908
Response IP 104.26.12.50
Found Yes
Hash cc57005c669008da79057013d00321d2249b27918a0a2c9b3bb50abf63881ca3
SimHash 6941097ecb82

Groups

*

Rule Path
Disallow /old
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /*s%3D*
Disallow /archives/
Disallow *?replytocom
Disallow /comments/feed/
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /*?*

*

Rule Path
Disallow /site

bingbot
googlebot
slurp

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.usatranslate.com/sitemap_index.xml
sitemap https://www.usatranslate.com/site/sitemap.xml