allaboutfcbarcelona.com
robots.txt
Robots Exclusion Standard data for allaboutfcbarcelona.com
Resource Scan
Scan Details
| Site Domain | allaboutfcbarcelona.com |
| Base Domain | allaboutfcbarcelona.com |
| Scan Status | Ok |
| Last Scan | 2024-10-01T20:33:10+00:00 |
| Next Scan | 2024-10-08T20:33:10+00:00 |
Last Scan
| Scanned | 2024-10-01T20:33:10+00:00 |
| URL | https://www.allaboutfcbarcelona.com/robots.txt |
| Domain IPs | 2404:6800:4003:c1c::79, 74.125.68.121 |
| Response IP | 74.125.200.121 |
| Found | Yes |
| Hash | 40ca0bb13d44bf0b194ce97306ec2bca8f2491f60706ba0dbb2c52846976f193 |
| SimHash | 8844d260ce71 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?updated-min= |
| Disallow | /search?updated-max= |
| Disallow | /search/label/*?updated-min= |
| Disallow | /search/label/*?updated-max= |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allaboutfcbarcelona.com/feeds/posts/default?orderby=UPDATED |
| sitemap | https://www.allaboutfcbarcelona.com/atom.xml?redirect=false&start-index=1&max-results=500 |
| sitemap | https://www.allaboutfcbarcelona.com/atom.xml?redirect=false&start-index=501&max-results=500 |
| sitemap | https://www.allaboutfcbarcelona.com/atom.xml?redirect=false&start-index=1001&max-results=500 |
| sitemap | https://www.allaboutfcbarcelona.com/atom.xml?redirect=false&start-index=1501&max-results=500 |
| sitemap | https://www.allaboutfcbarcelona.com/atom.xml?redirect=false&start-index=2001&max-results=500 |