es.digitaltrends.com
robots.txt

Robots Exclusion Standard data for es.digitaltrends.com

Resource Scan

Scan Details

Site Domain es.digitaltrends.com
Base Domain digitaltrends.com
Scan Status Ok
Last Scan2024-10-18T16:10:32+00:00
Next Scan 2024-11-17T16:10:32+00:00

Last Scan

Scanned2024-10-18T16:10:32+00:00
URL https://es.digitaltrends.com/robots.txt
Domain IPs 192.0.66.184, 2a04:fa87:fffd::c000:42b8
Response IP 192.0.66.184
Found Yes
Hash 685938f42a9027955f61f48bea99333f0e5ab7a78137c7dd7222a8d25be5c266
SimHash 7a29f2248bf2

Groups

magpie-crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /?s=
Disallow /search

Other Records

Field Value
sitemap https://es.digitaltrends.com/sitemap-all-content-index.xml
sitemap https://es.digitaltrends.com/sitemap-all-images-index.xml
sitemap https://es.digitaltrends.com/sitemap-google-news-index.xml
sitemap https://es.digitaltrends.com/sitemap-latest-500-index.xml
sitemap https://es.digitaltrends.com/sitemap-news-sitemap-index.xml
sitemap https://es.digitaltrends.com/sitemaps/all-content/index.xml