notifications.spiceworks.com
robots.txt

Robots Exclusion Standard data for notifications.spiceworks.com

Resource Scan

Scan Details

Site Domain notifications.spiceworks.com
Base Domain spiceworks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-04T07:16:52+00:00
Next Scan 2024-10-02T07:16:52+00:00

Last Successful Scan

Scanned2024-02-29T07:15:39+00:00
URL https://notifications.spiceworks.com/robots.txt
Domain IPs 45.60.15.212
Response IP 45.60.15.212
Found Yes
Hash 0f7e7cdbcc3a7537616ffdbe8d897573f92c255be644903c266c8228c5007d8e
SimHash e842e8d5c130

Groups

*

Rule Path
Disallow /user/
Disallow /subscription
Disallow /verification
Disallow /welcome
Disallow /oauth
Disallow /public_oauth
Disallow /topic/print
Disallow /reports/import
Disallow /plugin/import
Disallow /a?
Disallow /frontend
Disallow /quotes
Disallow /plugin/download_history_stats
Disallow /server-id
Disallow /business_cases
Disallow /private
Disallow /join
Disallow /helpdesk
Disallow /messages/
Disallow /topic/new
Disallow /scripts/new
Disallow /profile/edit_profile
Disallow /*/rate$
Disallow /*/add_choice$
Disallow /*/stats$
Disallow /community.spiceworks.com/
Disallow /static.spiceworks.com/
Disallow /*/count_topics_by_forum
Disallow /watson
Disallow /meeting/export_to_ical/
Disallow /app/frames/
Disallow /r/
Disallow /purchasing
Disallow /shopping_list_proxy
Disallow /scripts/subscribe/*
Disallow /*/print$
Disallow /topic_polls/get_voters
Disallow /reviews/new
Disallow /questions/new
Disallow /how_to/new
Disallow /people/*/activity/shared
Disallow /people/*/activity/helpful-votes
Disallow /people/*/activity/spiceups
Disallow /feature_request/*
Disallow /appcenter/*
Disallow /search/*
Disallow /search/?query=

voltron

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://community.spiceworks.com/sitemap_index.xml.gz
sitemap https://community.spiceworks.com/sitemap_recent.xml