nextory.com
robots.txt
Robots Exclusion Standard data for nextory.com
Resource Scan
Scan Details
Site Domain | nextory.com |
Base Domain | nextory.com |
Scan Status | Ok |
Last Scan | 2025-08-30T02:04:08+00:00 |
Next Scan | 2025-09-13T02:04:08+00:00 |
Last Scan
Scanned | 2025-08-30T02:04:08+00:00 |
URL | https://nextory.com/robots.txt |
Domain IPs | 34.117.149.235 |
Response IP | 34.117.149.235 |
Found | Yes |
Hash | 293823068ca94f1fffab21010533a16695547627bf460f04aade2c9104afc409 |
SimHash | 8c6af120bcbb |
Groups
*
Rule | Path |
---|---|
Disallow | /se/collab |
Disallow | /fr/collab |
Disallow | /be-fr/collab |
Disallow | /nl/collab |
Disallow | /no/collab |
Disallow | /es/collab |
Disallow | /dk/collab |
Disallow | /fi/collab |
Disallow | /ch/collab |
Disallow | /at/collab |
Disallow | /de/collab |
Disallow | /se/search |
Disallow | /fr/search |
Disallow | /be-fr/search |
Disallow | /nl/search |
Disallow | /no/search |
Disallow | /es/search |
Disallow | /dk/search |
Disallow | /fi/search |
Disallow | /ch/search |
Disallow | /at/search |
Disallow | /de/search |
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
Rule | Path |
---|---|
Disallow | / |
Disallow | /se/ |
Disallow | /fr/ |
Disallow | /be-fr/ |
Disallow | /nl/ |
Disallow | /no/ |
Disallow | /es/ |
Disallow | /dk/ |
Disallow | /fi/ |
Disallow | /ch/ |
Disallow | /at/ |
Disallow | /de/ |
Other Records
Field | Value |
---|---|
sitemap | https://assets.nextory.com/sitemaps/sitemap-web-index.xml |
sitemap | https://nextory.com/sitemap_index.xml |
Comments