gaya-sa.org
robots.txt
Robots Exclusion Standard data for gaya-sa.org
Resource Scan
Scan Details
Site Domain | gaya-sa.org |
Base Domain | gaya-sa.org |
Scan Status | Ok |
Last Scan | 2025-03-10T13:28:19+00:00 |
Next Scan | 2025-03-17T13:28:19+00:00 |
Last Scan
Scanned | 2025-03-10T13:28:19+00:00 |
URL | https://gaya-sa.org/robots.txt |
Domain IPs | 104.21.64.249, 172.67.188.56, 2606:4700:3031::ac43:bc38, 2606:4700:3037::6815:40f9 |
Response IP | 172.67.188.56 |
Found | Yes |
Hash | f4cd5701944edff7fdecadc0005108685bc6badf465485c1492857bb913f72f7 |
SimHash | eeb998096e53 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*?page= |
Disallow | /forum/*?page= |
Disallow | /search/* |
Disallow | /search.html/* |
Disallow | /search.html*?query= |
Disallow | /archive.html/* |
Disallow | /archive.html*?publishDateDay= |
Disallow | /panel |
Disallow | /cron |
Disallow | /ajax |
Disallow | /widgets_factory |
Disallow | /auth |
Disallow | /login |
Disallow | /register |
Disallow | /style |
Disallow | /printit |
Disallow | /emailthis |
Disallow | /outside |
Other Records
Field | Value |
---|---|
sitemap | https://gaya-sa.org/sitemap.xml |
sitemap | https://gaya-sa.org/sitemap.xml?format=google_news |