2941.com
robots.txt

Robots Exclusion Standard data for 2941.com

Resource Scan

Scan Details

Site Domain 2941.com
Base Domain 2941.com
Scan Status Ok
Last Scan2025-12-23T09:06:15+00:00
Next Scan 2026-01-22T09:06:15+00:00

Last Scan

Scanned2025-12-23T09:06:15+00:00
URL https://2941.com/robots.txt
Redirect https://www.2941.com/robots.txt
Redirect Domain www.2941.com
Redirect Base 2941.com
Domain IPs 199.34.228.77
Redirect IPs 199.34.228.77
Response IP 199.34.228.77
Found Yes
Hash f7bc5109dd493a49c6b87447a1ccbd47eeac693e5db5cb612c0994bfb68f0f1f
SimHash f006dc542fd2

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /asian-heritage.html
Disallow /easter-carryout.html
Disallow /https%3A//www.giftrocker.com/secure/order/?h=6683b6e5
Disallow /james-beard-menu.html
Disallow /mastering-spice.html
Disallow /menus.html
Disallow /barmenu.html
Disallow /extended-restaurant-week-lunch-menu.html
Disallow /market.html
Disallow /new-years-eve-menu.html
Disallow /decadence-menu.html
Disallow /mothers-day-menu.html
Disallow /oldmenupage.html
Disallow /upcoming-events.html
Disallow /eastermenu.html
Disallow /christmas-eve-lunch.html
Disallow /thanksgiving-menu.html
Disallow /private-events.html
Disallow /wine-dinner.html
Disallow /reservations.html
Disallow /orin-swift-wine-dinner.html
Disallow /prix-fixe-dinner-menu.html
Disallow /test.html
Disallow /christmas-eve-menu.html
Disallow /virtual-meeting.html
Disallow /2941-photo-contest.html
Disallow /thanksgiving-carryout.html
Disallow /carryout-fathersday.html
Disallow /wineclub.html
Disallow /bmp.html
Disallow /vip.html

Other Records

Field Value
sitemap https://www.2941.com/sitemap.xml