turbify.com
robots.txt

Robots Exclusion Standard data for turbify.com

Resource Scan

Scan Details

Site Domain turbify.com
Base Domain turbify.com
Scan Status Ok
Last Scan2024-06-23T15:15:15+00:00
Next Scan 2024-07-23T15:15:15+00:00

Last Scan

Scanned2024-06-23T15:15:15+00:00
URL https://turbify.com/robots.txt
Redirect https://www.turbify.com:443/robots.txt
Redirect Domain www.turbify.com
Redirect Base turbify.com
Domain IPs 34.237.116.43, 44.218.123.2
Redirect IPs 34.237.116.43, 44.218.123.2
Response IP 34.237.116.43
Found Yes
Hash 06123aa5f6dfc36bf78672790d1b1068db20442602454d86d52a90f2c37c93ca
SimHash dd5cd0baf173

Groups

*

Rule Path
Disallow /_xhr/
Disallow /services/
Disallow /servicecheck/
Disallow /upgrade.html/
Disallow /tos/CA/privacy/

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

twitterbot

Rule Path
Allow /imgres

facebookexternalhit

Rule Path
Allow /imgres
Allow /

Other Records

Field Value
sitemap https://www.turbify.com/sitemap.xml
sitemap https://resources.turbify.com/sitemap_index.xml