talkwalker.com
robots.txt

Robots Exclusion Standard data for talkwalker.com

Resource Scan

Scan Details

Site Domain talkwalker.com
Base Domain talkwalker.com
Scan Status Ok
Last Scan2024-05-27T15:14:50+00:00
Next Scan 2024-06-26T15:14:50+00:00

Last Scan

Scanned2024-05-27T15:14:50+00:00
URL https://talkwalker.com/robots.txt
Redirect https://www.talkwalker.com/robots.txt
Redirect Domain www.talkwalker.com
Redirect Base talkwalker.com
Domain IPs 144.76.143.225
Redirect IPs 141.101.90.96, 141.101.90.97, 141.101.90.98, 141.101.90.99, 2a06:98c1:3200::90:0, 2a06:98c1:3200::90:1, 2a06:98c1:3200::90:2, 2a06:98c1:3200::90:3
Response IP 141.101.90.98
Found Yes
Hash a0b9e721a7f48406dad6ce5b9cd825a79f1a4574525cb6c104942af54c5752f4
SimHash 1d44c8755c96

Groups

*

Rule Path
Disallow /free-demo-signup-thanks
Disallow /download-thank-you
Disallow /es/gracias-por-contactarnos
Disallow /it/contatta-talkwalker-grazie
Disallow /thank-you-free-search
Disallow /pricing-thanks
Disallow /fr/pricing-thanks
Disallow /de/pricing-thanks
Disallow /it/pricing-thanks
Disallow /es/pricing-thanks
Disallow /ja/pricing-thanks
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

Other Records

Field Value
sitemap https://talkwalker.com/sitemap_index.xml

Warnings

  • 5 invalid lines.