turbify.net
robots.txt

Robots Exclusion Standard data for turbify.net

Resource Scan

Scan Details

Site Domain turbify.net
Base Domain turbify.net
Scan Status Ok
Last Scan2024-05-30T09:18:47+00:00
Next Scan 2024-06-29T09:18:47+00:00

Last Scan

Scanned2024-05-30T09:18:47+00:00
URL https://turbify.net/robots.txt
Redirect https://www.turbify.com:443/robots.txt
Redirect Domain www.turbify.com
Redirect Base turbify.com
Domain IPs 34.193.179.226, 54.83.126.201
Redirect IPs 52.71.237.35, 52.72.155.155
Response IP 52.72.155.155
Found Yes
Hash 06123aa5f6dfc36bf78672790d1b1068db20442602454d86d52a90f2c37c93ca
SimHash dd5cd0baf173

Groups

*

Rule Path
Disallow /_xhr/
Disallow /services/
Disallow /servicecheck/
Disallow /upgrade.html/
Disallow /tos/CA/privacy/

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

twitterbot

Rule Path
Allow /imgres

facebookexternalhit

Rule Path
Allow /imgres
Allow /

Other Records

Field Value
sitemap https://www.turbify.com/sitemap.xml
sitemap https://resources.turbify.com/sitemap_index.xml