ask.slashdot.org
robots.txt

Robots Exclusion Standard data for ask.slashdot.org

Resource Scan

Scan Details

Site Domain ask.slashdot.org
Base Domain slashdot.org
Scan Status Ok
Last Scan2024-06-24T07:41:26+00:00
Next Scan 2024-07-24T07:41:26+00:00

Last Scan

Scanned2024-06-24T07:41:26+00:00
URL https://ask.slashdot.org/robots.txt
Redirect https://slashdot.org/robots.txt
Redirect Domain slashdot.org
Redirect Base slashdot.org
Domain IPs 104.18.36.64, 172.64.151.192
Redirect IPs 104.18.36.64, 172.64.151.192
Response IP 172.64.151.192
Found Yes
Hash b0c5b8aaa4c04a6ab30e81cb73c19b1a9c838f5caeafc0d46f08e420f1244891
SimHash d1140da78df6

Groups

gptbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

*

Rule Path
Disallow /authors.pl
Disallow /index.pl
Disallow /index2.pl
Disallow /comments.pl
Disallow /firehose.pl
Disallow /journal.pl
Disallow /messages.pl
Disallow /metamod.pl
Disallow /users.pl
Disallow /search.pl
Disallow /submit.pl
Disallow /pollBooth.pl
Disallow /pubkey.pl
Disallow /topics.pl
Disallow /zoo.pl
Disallow /palm
Disallow /slashdot-it.pl
Disallow /bookmark.pl
Disallow /~
Disallow /~
Disallow /submission
Disallow /?issue=
Disallow /software/visit?
Disallow /software/tp/?
Disallow /software/comparison/*-vs-*-vs-*-vs-*-vs-
Disallow /software/comparison/*/add-software
Disallow /software/*?q=
Disallow /software/*%26q%3D
Disallow /software/*?categories=
Disallow /software/*%26categories%3D
Disallow /software/*?company_sizes=
Disallow /software/*%26company_sizes%3D
Disallow /software/*?deployment=
Disallow /software/*%26deployment%3D
Disallow /software/*?free_options=
Disallow /software/*%26free_options%3D
Disallow /software/*?integrates_with=
Disallow /software/*%26integrates_with%3D
Disallow /software/*?org_types=
Disallow /software/*%26org_types%3D
Disallow /software/*?api=
Disallow /software/*%26api%3D
Disallow /software/*?regions=
Disallow /software/*%26regions%3D
Disallow /software/*?support=
Disallow /software/*%26support%3D
Disallow /software/*?training=
Disallow /software/*%26training%3D
Disallow /software/*?feature_
Disallow /software/*%26feature_
Disallow /software/*?deployment=
Disallow /software/*%26deployment%3D
Disallow /jobs

Other Records

Field Value
sitemap https://slashdot.org/sitemap-slashdot-index.xml
sitemap https://apache.slashdot.org/sitemap-apache-index.xml
sitemap https://apple.slashdot.org/sitemap-apple-index.xml
sitemap https://askslashdot.slashdot.org/sitemap-askslashdot-index.xml
sitemap https://books.slashdot.org/sitemap-bookreview-index.xml
sitemap https://bsd.slashdot.org/sitemap-bsd-index.xml
sitemap https://build.slashdot.org/sitemap-build-index.xml
sitemap https://developers.slashdot.org/sitemap-developers-index.xml
sitemap https://devices.slashdot.org/sitemap-devices-index.xml
sitemap https://entertainment.slashdot.org/sitemap-entertainment-index.xml
sitemap https://features.slashdot.org/sitemap-features-index.xml
sitemap https://games.slashdot.org/sitemap-games-index.xml
sitemap https://hardware.slashdot.org/sitemap-hardware-index.xml
sitemap https://idle.slashdot.org/sitemap-idle-index.xml
sitemap https://interviews.slashdot.org/sitemap-interviews-index.xml
sitemap https://it.slashdot.org/sitemap-it-index.xml
sitemap https://linux.slashdot.org/sitemap-linux-index.xml
sitemap https://meta.slashdot.org/sitemap-meta-index.xml
sitemap https://mobile.slashdot.org/sitemap-mobile-index.xml
sitemap https://news.slashdot.org/sitemap-news-index.xml
sitemap https://politics.slashdot.org/sitemap-politics-index.xml
sitemap https://radio.slashdot.org/sitemap-radio-index.xml
sitemap https://science.slashdot.org/sitemap-science-index.xml
sitemap https://search.slashdot.org/sitemap-search-index.xml
sitemap https://technology.slashdot.org/sitemap-technology-index.xml
sitemap https://yro.slashdot.org/sitemap-yro-index.xml
sitemap https://slashdot.org/software/software_sitemap.xml

Comments

  • robots.txt for Slashdot.org