yupiii.gr
robots.txt

Robots Exclusion Standard data for yupiii.gr

Resource Scan

Scan Details

Site Domain yupiii.gr
Base Domain yupiii.gr
Scan Status Ok
Last Scan2024-06-14T22:44:49+00:00
Next Scan 2024-06-21T22:44:49+00:00

Last Scan

Scanned2024-06-14T22:44:49+00:00
URL https://yupiii.gr/robots.txt
Redirect https://www.yupiii.gr/robots.txt
Redirect Domain www.yupiii.gr
Redirect Base yupiii.gr
Domain IPs 104.21.63.30, 172.67.142.171, 2606:4700:3036::6815:3f1e, 2606:4700:3037::ac43:8eab
Redirect IPs 23.59.168.138
Response IP 23.52.40.106
Found Yes
Hash 774144df153bee68b1249d1dec2f4a71ae969aadc4b7e82c13abac7f1c765b84
SimHash 331fc04241f5

Groups

*

Rule Path
Disallow
Disallow /Newsletter*
Disallow /newsletter*
Disallow /webtv/videofeed*

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.yupiii.gr/sitemap/allnews
sitemap https://www.yupiii.gr/sitemap/googlenews
sitemap https://www.yupiii.gr/sitemap/categories

Comments

  • Disallow: /Api/*
  • Disallow: /api/*
  • Disallow: /Search*
  • Disallow: /search*