slashdot.org
robots.txt
Robots Exclusion Standard data for slashdot.org
Resource Scan
Scan Details
| Site Domain | slashdot.org |
| Base Domain | slashdot.org |
| Scan Status | Ok |
| Last Scan | 2024-11-08T23:57:39+00:00 |
| Next Scan | 2024-11-15T23:57:39+00:00 |
Last Scan
| Scanned | 2024-11-08T23:57:39+00:00 |
| URL | https://slashdot.org/robots.txt |
| Domain IPs | 104.18.36.64, 172.64.151.192 |
| Response IP | 104.18.36.64 |
| Found | Yes |
| Hash | c0b9f3f7455b916b72ea186bbcc898fe451a29c2c46e5b1553b2588f3c94593a |
| SimHash | e1061daf8def |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /authors.pl |
| Disallow | /index.pl |
| Disallow | /index2.pl |
| Disallow | /firehose.pl |
| Disallow | /messages.pl |
| Disallow | /metamod.pl |
| Disallow | /users.pl |
| Disallow | /users2.pl |
| Disallow | /search.pl |
| Disallow | /search |
| Disallow | /submit.pl |
| Disallow | /pollBooth.pl |
| Disallow | /pubkey.pl |
| Disallow | /topics.pl |
| Disallow | /zoo.pl |
| Disallow | /palm |
| Disallow | /bookmark.pl |
| Disallow | /~ |
| Disallow | /~*/friends |
| Disallow | /~*/fans |
| Disallow | /~*/foes |
| Disallow | /~*/freaks |
| Disallow | /~*/tags |
| Disallow | /~*/achievements |
| Disallow | /submission |
| Disallow | /journal |
| Disallow | /comments.pl |
| Disallow | /slashdot-it.pl |
| Disallow | /tag |
| Disallow | /stories/ |
| Disallow | /interviews/ |
| Disallow | /?issue= |
| Disallow | /software/link? |
| Disallow | /software/link$ |
| Disallow | /software/visit? |
| Disallow | /software/visit$ |
| Disallow | /software/tp/? |
| Disallow | /software/comparison/*-vs-*-vs-*-vs- |
| Disallow | /software/comparison/*/add-software |
| Disallow | /software/*?q= |
| Disallow | /software/*%26q%3D |
| Disallow | /software/*?categories= |
| Disallow | /software/*%26categories%3D |
| Disallow | /software/*?company_sizes= |
| Disallow | /software/*%26company_sizes%3D |
| Disallow | /software/*?deployment= |
| Disallow | /software/*%26deployment%3D |
| Disallow | /software/*?free_options= |
| Disallow | /software/*%26free_options%3D |
| Disallow | /software/*?integrates_with= |
| Disallow | /software/*%26integrates_with%3D |
| Disallow | /software/*?org_types= |
| Disallow | /software/*%26org_types%3D |
| Disallow | /software/*?api= |
| Disallow | /software/*%26api%3D |
| Disallow | /software/*?regions= |
| Disallow | /software/*%26regions%3D |
| Disallow | /software/*?support= |
| Disallow | /software/*%26support%3D |
| Disallow | /software/*?training= |
| Disallow | /software/*%26training%3D |
| Disallow | /software/*?feature_ |
| Disallow | /software/*%26feature_ |
| Disallow | /software/*?deployment= |
| Disallow | /software/*%26deployment%3D |
| Disallow | /software/transfer_site |
| Disallow | /jobs |
| Disallow | /software/tp3 |
| Disallow | /directory/tp |
| Disallow | /my/ |
| Disallow | /*/wp-login.php |
| Disallow | /supporters.shtml |
| Disallow | /topics.shtml |
| Disallow | /awards.shtml |
| Disallow | /login.pl |
| Disallow | /api/v2/record_user_opt_out |
| Disallow | /prefs |
| Disallow | /content/category/ |
| Disallow | /content/tag/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://slashdot.org/sitemap-slashdot-index.xml |
| sitemap | https://apache.slashdot.org/sitemap-apache-index.xml |
| sitemap | https://apple.slashdot.org/sitemap-apple-index.xml |
| sitemap | https://askslashdot.slashdot.org/sitemap-askslashdot-index.xml |
| sitemap | https://books.slashdot.org/sitemap-bookreview-index.xml |
| sitemap | https://bsd.slashdot.org/sitemap-bsd-index.xml |
| sitemap | https://build.slashdot.org/sitemap-build-index.xml |
| sitemap | https://developers.slashdot.org/sitemap-developers-index.xml |
| sitemap | https://devices.slashdot.org/sitemap-devices-index.xml |
| sitemap | https://entertainment.slashdot.org/sitemap-entertainment-index.xml |
| sitemap | https://features.slashdot.org/sitemap-features-index.xml |
| sitemap | https://games.slashdot.org/sitemap-games-index.xml |
| sitemap | https://hardware.slashdot.org/sitemap-hardware-index.xml |
| sitemap | https://idle.slashdot.org/sitemap-idle-index.xml |
| sitemap | https://interviews.slashdot.org/sitemap-interviews-index.xml |
| sitemap | https://it.slashdot.org/sitemap-it-index.xml |
| sitemap | https://linux.slashdot.org/sitemap-linux-index.xml |
| sitemap | https://meta.slashdot.org/sitemap-meta-index.xml |
| sitemap | https://mobile.slashdot.org/sitemap-mobile-index.xml |
| sitemap | https://news.slashdot.org/sitemap-news-index.xml |
| sitemap | https://politics.slashdot.org/sitemap-politics-index.xml |
| sitemap | https://radio.slashdot.org/sitemap-radio-index.xml |
| sitemap | https://science.slashdot.org/sitemap-science-index.xml |
| sitemap | https://search.slashdot.org/sitemap-search-index.xml |
| sitemap | https://technology.slashdot.org/sitemap-technology-index.xml |
| sitemap | https://yro.slashdot.org/sitemap-yro-index.xml |
| sitemap | https://slashdot.org/software/software_sitemap.xml |
Comments