ncatlab.org
robots.txt

Robots Exclusion Standard data for ncatlab.org

Resource Scan

Scan Details

Site Domain ncatlab.org
Base Domain ncatlab.org
Scan Status Ok
Last Scan2024-12-01T14:36:24+00:00
Next Scan 2024-12-31T14:36:24+00:00

Last Scan

Scanned2024-12-01T14:36:24+00:00
URL https://ncatlab.org/robots.txt
Domain IPs 128.2.25.48
Response IP 128.2.25.48
Found Yes
Hash c7e087e1fecfb08d542579cb04c56bba380708afa91d6e8927d6f8c9a6b454ad
SimHash 036ab105ed76

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /nlab/feeds
Disallow /nlab/export
Disallow /nlab/revision
Disallow /nlab/show/diff/
Disallow /nlab/print
Disallow /nlab/tex
Disallow /nlab/pdf
Disallow /nlab/list
Disallow /schreiber/feeds
Disallow /schreiber/export
Disallow /schreiber/revision
Disallow /schreiber/show/diff/
Disallow /schreiber/print
Disallow /schreiber/tex
Disallow /schreiber/pdf
Disallow /schreiber/list
Disallow /ericforgy/feeds
Disallow /ericforgy/export
Disallow /ericforgy/revision
Disallow /ericforgy/show/diff/
Disallow /ericforgy/print
Disallow /ericforgy/tex
Disallow /ericforgy/pdf
Disallow /ericforgy/list
Disallow /michaelshulman/feeds
Disallow /michaelshulman/export
Disallow /michaelshulman/revision
Disallow /michaelshulman/show/diff/
Disallow /michaelshulman/print
Disallow /michaelshulman/tex
Disallow /michaelshulman/pdf
Disallow /michaelshulman/list
Disallow /toddtrimble/feeds
Disallow /toddtrimble/export
Disallow /toddtrimble/revision
Disallow /toddtrimble/show/diff/
Disallow /toddtrimble/print
Disallow /toddtrimble/tex
Disallow /toddtrimble/pdf
Disallow /toddtrimble/list
Disallow /davidroberts/feeds
Disallow /davidroberts/export
Disallow /davidroberts/revision
Disallow /davidroberts/show/diff/
Disallow /davidroberts/print
Disallow /davidroberts/tex
Disallow /davidroberts/pdf
Disallow /davidroberts/list
Disallow /tobybartels/feeds
Disallow /tobybartels/export
Disallow /tobybartels/revision
Disallow /tobybartels/show/diff/
Disallow /tobybartels/print
Disallow /tobybartels/tex
Disallow /tobybartels/pdf
Disallow /tobybartels/list
Disallow /jamesdolan/feeds
Disallow /jamesdolan/export
Disallow /jamesdolan/revision
Disallow /jamesdolan/show/diff/
Disallow /jamesdolan/print
Disallow /jamesdolan/tex
Disallow /jamesdolan/pdf
Disallow /jamesdolan/list
Disallow /timporter/feeds
Disallow /timporter/export
Disallow /timporter/revision
Disallow /timporter/show/diff/
Disallow /timporter/print
Disallow /timporter/tex
Disallow /timporter/pdf
Disallow /timporter/list
Disallow /zoranskoda/feeds
Disallow /zoranskoda/export
Disallow /zoranskoda/revision
Disallow /zoranskoda/show/diff/
Disallow /zoranskoda/print
Disallow /zoranskoda/tex
Disallow /zoranskoda/pdf
Disallow /zoranskoda/list
Disallow /davidcorfield/feeds
Disallow /davidcorfield/export
Disallow /davidcorfield/revision
Disallow /davidcorfield/show/diff/
Disallow /davidcorfield/print
Disallow /davidcorfield/tex
Disallow /davidcorfield/pdf
Disallow /davidcorfield/list
Disallow /alexhoffnung/feeds
Disallow /alexhoffnung/export
Disallow /alexhoffnung/revision
Disallow /alexhoffnung/show/diff/
Disallow /alexhoffnung/print
Disallow /alexhoffnung/tex
Disallow /alexhoffnung/pdf
Disallow /alexhoffnung/list
Disallow /johnbaez/feeds
Disallow /johnbaez/export
Disallow /johnbaez/revision
Disallow /johnbaez/show/diff/
Disallow /johnbaez/print
Disallow /johnbaez/tex
Disallow /johnbaez/pdf
Disallow /johnbaez/list
Disallow /brucebartlett/feeds
Disallow /brucebartlett/export
Disallow /brucebartlett/revision
Disallow /brucebartlett/show/diff/
Disallow /brucebartlett/print
Disallow /brucebartlett/tex
Disallow /brucebartlett/pdf
Disallow /brucebartlett/list
Disallow /nlabmeta/feeds
Disallow /nlabmeta/export
Disallow /nlabmeta/revision
Disallow /nlabmeta/show/diff/
Disallow /nlabmeta/print
Disallow /nlabmeta/tex
Disallow /nlabmeta/pdf
Disallow /nlabmeta/list
Disallow /schreiberprivate/feeds
Disallow /schreiberprivate/export
Disallow /schreiberprivate/revision
Disallow /schreiberprivate/show/diff/
Disallow /schreiberprivate/print
Disallow /schreiberprivate/tex
Disallow /schreiberprivate/pdf
Disallow /schreiberprivate/list
Disallow /doriath/feeds
Disallow /doriath/export
Disallow /doriath/revision
Disallow /doriath/show/diff/
Disallow /doriath/print
Disallow /doriath/tex
Disallow /doriath/pdf
Disallow /doriath/list
Disallow /bwebster/feeds
Disallow /bwebster/export
Disallow /bwebster/revision
Disallow /bwebster/show/diff/
Disallow /bwebster/print
Disallow /bwebster/tex
Disallow /bwebster/pdf
Disallow /bwebster/list
Disallow /chrisrogers/feeds
Disallow /chrisrogers/export
Disallow /chrisrogers/revision
Disallow /chrisrogers/show/diff/
Disallow /chrisrogers/print
Disallow /chrisrogers/tex
Disallow /chrisrogers/pdf
Disallow /chrisrogers/list
Disallow /domenicofiorenza/feeds
Disallow /domenicofiorenza/export
Disallow /domenicofiorenza/revision
Disallow /domenicofiorenza/show/diff/
Disallow /domenicofiorenza/print
Disallow /domenicofiorenza/tex
Disallow /domenicofiorenza/pdf
Disallow /domenicofiorenza/list
Disallow /dstevenson/feeds
Disallow /dstevenson/export
Disallow /dstevenson/revision
Disallow /dstevenson/show/diff/
Disallow /dstevenson/print
Disallow /dstevenson/tex
Disallow /dstevenson/pdf
Disallow /dstevenson/list
Disallow /joyalscatlab/feeds
Disallow /joyalscatlab/export
Disallow /joyalscatlab/revision
Disallow /joyalscatlab/show/diff/
Disallow /joyalscatlab/print
Disallow /joyalscatlab/tex
Disallow /joyalscatlab/pdf
Disallow /joyalscatlab/list
Disallow /eregion/feeds
Disallow /eregion/export
Disallow /eregion/revision
Disallow /eregion/show/diff/
Disallow /eregion/print
Disallow /eregion/tex
Disallow /eregion/pdf
Disallow /eregion/list
Disallow /nlab/history
Disallow /nlab/source
Disallow /nlab/atom_with_content
Disallow /nlab/atom_with_headlines
Disallow /nlab/s5
Disallow /nlab/search
Disallow /nlab/authors
Disallow /nlab/recently_revised
Disallow /schreiber/history
Disallow /schreiber/source
Disallow /schreiber/atom_with_content
Disallow /schreiber/atom_with_headlines
Disallow /schreiber/s5
Disallow /schreiber/search
Disallow /schreiber/authors
Disallow /schreiber/recently_revised
Disallow /ericforgy/history
Disallow /ericforgy/source
Disallow /ericforgy/atom_with_content
Disallow /ericforgy/atom_with_headlines
Disallow /ericforgy/s5
Disallow /ericforgy/search
Disallow /ericforgy/authors
Disallow /ericforgy/recently_revised
Disallow /michaelshulman/history
Disallow /michaelshulman/source
Disallow /michaelshulman/atom_with_content
Disallow /michaelshulman/atom_with_headlines
Disallow /michaelshulman/s5
Disallow /michaelshulman/search
Disallow /michaelshulman/authors
Disallow /michaelshulman/recently_revised
Disallow /toddtrimble/history
Disallow /toddtrimble/source
Disallow /toddtrimble/atom_with_content
Disallow /toddtrimble/atom_with_headlines
Disallow /toddtrimble/s5
Disallow /toddtrimble/search
Disallow /toddtrimble/authors
Disallow /toddtrimble/recently_revised
Disallow /davidroberts/history
Disallow /davidroberts/source
Disallow /davidroberts/atom_with_content
Disallow /davidroberts/atom_with_headlines
Disallow /davidroberts/s5
Disallow /davidroberts/search
Disallow /davidroberts/authors
Disallow /davidroberts/recently_revised
Disallow /tobybartels/history
Disallow /tobybartels/source
Disallow /tobybartels/atom_with_content
Disallow /tobybartels/atom_with_headlines
Disallow /tobybartels/s5
Disallow /tobybartels/search
Disallow /tobybartels/authors
Disallow /tobybartels/recently_revised
Disallow /jamesdolan/history
Disallow /jamesdolan/source
Disallow /jamesdolan/atom_with_content
Disallow /jamesdolan/atom_with_headlines
Disallow /jamesdolan/s5
Disallow /jamesdolan/search
Disallow /jamesdolan/authors
Disallow /jamesdolan/recently_revised
Disallow /timporter/history
Disallow /timporter/source
Disallow /timporter/atom_with_content
Disallow /timporter/atom_with_headlines
Disallow /timporter/s5
Disallow /timporter/search
Disallow /timporter/authors
Disallow /timporter/recently_revised
Disallow /zoranskoda/history
Disallow /zoranskoda/source
Disallow /zoranskoda/atom_with_content
Disallow /zoranskoda/atom_with_headlines
Disallow /zoranskoda/s5
Disallow /zoranskoda/search
Disallow /zoranskoda/authors
Disallow /zoranskoda/recently_revised
Disallow /davidcorfield/history
Disallow /davidcorfield/source
Disallow /davidcorfield/atom_with_content
Disallow /davidcorfield/atom_with_headlines
Disallow /davidcorfield/s5
Disallow /davidcorfield/search
Disallow /davidcorfield/authors
Disallow /davidcorfield/recently_revised
Disallow /alexhoffnung/history
Disallow /alexhoffnung/source
Disallow /alexhoffnung/atom_with_content
Disallow /alexhoffnung/atom_with_headlines
Disallow /alexhoffnung/s5
Disallow /alexhoffnung/search
Disallow /alexhoffnung/authors
Disallow /alexhoffnung/recently_revised
Disallow /johnbaez/history
Disallow /johnbaez/source
Disallow /johnbaez/atom_with_content
Disallow /johnbaez/atom_with_headlines
Disallow /johnbaez/s5
Disallow /johnbaez/search
Disallow /johnbaez/authors
Disallow /johnbaez/recently_revised
Disallow /brucebartlett/history
Disallow /brucebartlett/source
Disallow /brucebartlett/atom_with_content
Disallow /brucebartlett/atom_with_headlines
Disallow /brucebartlett/s5
Disallow /brucebartlett/search
Disallow /brucebartlett/authors
Disallow /brucebartlett/recently_revised
Disallow /nlabmeta/history
Disallow /nlabmeta/source
Disallow /nlabmeta/atom_with_content
Disallow /nlabmeta/atom_with_headlines
Disallow /nlabmeta/s5
Disallow /nlabmeta/search
Disallow /nlabmeta/authors
Disallow /nlabmeta/recently_revised
Disallow /schreiberprivate/history
Disallow /schreiberprivate/source
Disallow /schreiberprivate/atom_with_content
Disallow /schreiberprivate/atom_with_headlines
Disallow /schreiberprivate/s5
Disallow /schreiberprivate/search
Disallow /schreiberprivate/authors
Disallow /schreiberprivate/recently_revised
Disallow /doriath/history
Disallow /doriath/source
Disallow /doriath/atom_with_content
Disallow /doriath/atom_with_headlines
Disallow /doriath/s5
Disallow /doriath/search
Disallow /doriath/authors
Disallow /doriath/recently_revised
Disallow /bwebster/history
Disallow /bwebster/source
Disallow /bwebster/atom_with_content
Disallow /bwebster/atom_with_headlines
Disallow /bwebster/s5
Disallow /bwebster/search
Disallow /bwebster/authors
Disallow /bwebster/recently_revised
Disallow /chrisrogers/history
Disallow /chrisrogers/source
Disallow /chrisrogers/atom_with_content
Disallow /chrisrogers/atom_with_headlines
Disallow /chrisrogers/s5
Disallow /chrisrogers/search
Disallow /chrisrogers/authors
Disallow /chrisrogers/recently_revised
Disallow /domenicofiorenza/history
Disallow /domenicofiorenza/source
Disallow /domenicofiorenza/atom_with_content
Disallow /domenicofiorenza/atom_with_headlines
Disallow /domenicofiorenza/s5
Disallow /domenicofiorenza/search
Disallow /domenicofiorenza/authors
Disallow /domenicofiorenza/recently_revised
Disallow /dstevenson/history
Disallow /dstevenson/source
Disallow /dstevenson/atom_with_content
Disallow /dstevenson/atom_with_headlines
Disallow /dstevenson/s5
Disallow /dstevenson/search
Disallow /dstevenson/authors
Disallow /dstevenson/recently_revised
Disallow /joyalscatlab/history
Disallow /joyalscatlab/source
Disallow /joyalscatlab/atom_with_content
Disallow /joyalscatlab/atom_with_headlines
Disallow /joyalscatlab/s5
Disallow /joyalscatlab/search
Disallow /joyalscatlab/authors
Disallow /joyalscatlab/recently_revised
Disallow /eregion/history
Disallow /eregion/source
Disallow /eregion/atom_with_content
Disallow /eregion/atom_with_headlines
Disallow /eregion/s5
Disallow /eregion/search
Disallow /eregion/authors
Disallow /eregion/recently_revised
Disallow /alexhoffnung/edit
Disallow /alexhoffnung/new
Disallow /another/edit
Disallow /another/new
Disallow /another_wiki/edit
Disallow /another_wiki/new
Disallow /baez/edit
Disallow /baez/new
Disallow /benwebster/edit
Disallow /benwebster/new
Disallow /brucebartlett/edit
Disallow /brucebartlett/new
Disallow /bwebster/edit
Disallow /bwebster/new
Disallow /chrisrogers/edit
Disallow /chrisrogers/new
Disallow /davidcorfield/edit
Disallow /davidcorfield/new
Disallow /davidroberts/edit
Disallow /davidroberts/new
Disallow /domenicofiorenza/edit
Disallow /domenicofiorenza/new
Disallow /doriath/edit
Disallow /doriath/new
Disallow /dstevenson/edit
Disallow /dstevenson/new
Disallow /eregion/edit
Disallow /eregion/new
Disallow /ericforgy/edit
Disallow /ericforgy/new
Disallow /finnlawler/edit
Disallow /finnlawler/new
Disallow /fpqc/edit
Disallow /fpqc/new
Disallow /ibakovic/edit
Disallow /ibakovic/new
Disallow /jamesdolan/edit
Disallow /jamesdolan/new
Disallow /johnbaez/edit
Disallow /johnbaez/new
Disallow /joyalscatlab/edit
Disallow /joyalscatlab/new
Disallow /kevinlin/edit
Disallow /kevinlin/new
Disallow /kevinlinprivate/edit
Disallow /kevinlinprivate/new
Disallow /lspace/edit
Disallow /lspace/new
Disallow /michaelshulman/edit
Disallow /michaelshulman/new
Disallow /my_wiki/edit
Disallow /my_wiki/new
Disallow /nlab/edit
Disallow /nlab/new
Disallow /nlabmeta/edit
Disallow /nlabmeta/new
Disallow /nlabreviewed/edit
Disallow /nlabreviewed/new
Disallow /publications/edit
Disallow /publications/new
Disallow /renamed_wiki1/edit
Disallow /renamed_wiki1/new
Disallow /roytenberg/edit
Disallow /roytenberg/new
Disallow /schreiber/edit
Disallow /schreiber/new
Disallow /schreiberprivate/edit
Disallow /schreiberprivate/new
Disallow /spahn/edit
Disallow /spahn/new
Disallow /timporter/edit
Disallow /timporter/new
Disallow /tobybartels/edit
Disallow /tobybartels/new
Disallow /toddtrimble/edit
Disallow /toddtrimble/new
Disallow /toddtrimble2/edit
Disallow /toddtrimble2/new
Disallow /topologygroupmoerdijk/edit
Disallow /topologygroupmoerdijk/new
Disallow /wiki1/edit
Disallow /wiki1/new
Disallow /wiki2/edit
Disallow /wiki2/new
Disallow /zoranprivate/edit
Disallow /zoranprivate/new
Disallow /zoranskoda/edit
Disallow /zoranskoda/new

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • robots.txt for http://ncatlab.org and aliases