invasiontalavera.es
robots.txt
Robots Exclusion Standard data for invasiontalavera.es
Resource Scan
Scan Details
Site Domain | invasiontalavera.es |
Base Domain | invasiontalavera.es |
Scan Status | Ok |
Last Scan | 2024-09-15T18:59:27+00:00 |
Next Scan | 2024-10-15T18:59:27+00:00 |
Last Scan
Scanned | 2024-09-15T18:59:27+00:00 |
URL | https://invasiontalavera.es/robots.txt |
Redirect | http://www.invasiontalavera.es/robots.txt |
Redirect Domain | www.invasiontalavera.es |
Redirect Base | invasiontalavera.es |
Domain IPs | 2001:41d0:301:4::27, 46.105.204.27 |
Redirect IPs | 2001:41d0:301:4::27, 46.105.204.27 |
Response IP | 46.105.204.27 |
Found | Yes |
Hash | 2f9ceabc5c6d217c88e1af8955674289250303c78bb23a41ba9050c04fea017d |
SimHash | a31e1d9343f5 |
Groups
googlebot
mediapartners-google*
bingbot
googlebot-image
googlebot-mobile
googlebot-image
slurp
robozilla
yahoo-mmcrawler
yahoo-mmcrawler
yahoo-blogs/v3.9
scooter
msnbot
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /awstats/ |
Disallow | /cli/ |
Disallow | /generator/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /*.php |
Disallow | /*?$ |
Disallow | /?fontstyle=f-smaller |
Disallow | /?fontstyle=f-larger |
*
Rule | Path |
---|---|
Allow | /*.js* |
Allow | /*.css* |
Allow | /*.png* |
Allow | /*.jpg* |
Allow | /*.gif* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | http://grupodwdemo.com/index.php?option=com_jmap&view=sitemap&format=xml |
sitemap | http://invasiontalavera.es/index.php?option=com_jmap&view=sitemap&format=xml |
Comments