day & night

 
Список ботов-пауков для IPB, Форумы
Дата публикации:
#1
PRYANIK



Made In Tula
[SoftoRooMTeaM] Group Icon

Группа: Администраторы
Сообщений: 31.138
Регистрация: 22.02.2004
Пользователь №: 7


Респектов: 6388
-----XXXXX




Моя небольшая коллекция ботов-пауков для IPB smile.gif...

Цитата | Quote
googlebot=Google.com
slurp@inktomi=Hot Bot
ask jeeves=Ask Jeeves
lycos=Lycos.com
whatuseek=What You Seek
ia_archiver=Archive.org
Acoon=Acoon bot
ah-ha.com=ah-ha bot
AnzwersCrawl=Australian search
appie=Walhello.com search
Arachnoidea=EuroSeek search
Araneo=Apparently spiders
ArchitextSpider=Excite spider
ask jeeves=Ask Jeeves
Atomz=Atomz bot
aWapClient=WAP content crawler
bumblebee=Relevare.com bot
CMC=Computer Music Center bot
ComputingSite=ComputingSite bot
crawler3=Altavista spider
Cruizer=Southafrican spider
Datenbank=Datenbank.de bot
DeepIndex=DeepIndex spider
Die Blinde Kuh=German Kids spider
Esther =Build database bot
ExplorerSearch=New Zealand Explorer
FreeCrawl=EuroSeek spider
Fast-WebCrawler=AllTheWeb spider
Fido=PlanetSearch spider
Gaisbot=GAIS spider
Gigabot=Unknown bot
googlebot=Google bot
Google=Google bot
Gulliver=Northern Light spider
Gulper Web Bot=Yuntis web robot
ia_archiver=Archive.org Bot
Icorus=Webmasterworld.com Bot
InfoSeek=InfoSeek spider
Iron33=Verno spider
JCrawler=Vietnamese search
IsraeliSearch=Israeli Society
KO Yappo=Yappo search
KIT Fireball=Fireball search
lycos=Lycos.com Bot
Mercator=Altavista spider
Mewsoft Search Engine=Newsoft spider
Motor=CyberCon Search spider
MSNBOT=MSN Search
MuscatFerret=EuroFerret database
MwdSearch=Finnish search
NEC MeshExplorer=NETPLAZA search
Nederland Zoek=Nederland.net search
NetScoop=NetScoop search
Nutch=open-source web search
Openbot=Openfind search
Openfind data gatherer=Openfind bot
Orb Search=Orb search
RHCS=RoadHouse search
Scooter=Altavista spider
Scrubby=Scrub The Web search
SearchTone=Developer's site spider
semanticdiscovery=Semanticdiscovery.com spider
Sidewinder=InfoSeek spider
Slurp=Inktomi/Hot Bot search
SwissSearch=Swiss search
szukacz=Polish searches
Tarantula=Altavista spider
Trek17=Altavista search
UdiSearch=Yahoo spider
UltraSeek=InfoSeek spider
Vagabondo=Mainly Dutch spider
Valkyrie=Japanese ODIN search
Voyager=Lisa search service
VWbot=SearchBC database spider
w3index=Scandinavian web spider
WebCrawler=WebCrawler search
WebQuest=Build search
Wired Digital=Wired Digital spider
whatuseek=What You Seek
YahooSeeker=Yahoo spider
Zealbot=LookSmart spider
ZyBorg=Wisenut search
jeeves=Ask Jeeves
google=Google.com
Asterias=Singingfish Spider
Slurp=Inktomi Spider
ZyBorg=LookSmart Bot
slurp@inktomi=HotBot
lycos=Lycos.com
LinkWalker=Link Walker
Slurp/2.0=HotBot
ABCdatos BotLink/1.0.2=ABC Bot
'Ahoy! The Homepage Finder'=Ahoy Spider
appie/1.1=Walhello Spider
InfoSeek Robot 1.0=Infoseek
Infoseek Sidewinder=Infoseek
MSNBOT/0.1=MSNBot
Openbot=OpenBot
inktomisearch.com=Yahoo
Slurp.so/1.0=Yahoo
Slurp/2.0j=Yahoo
Slurp/2.0-KiteHourly=Yahoo
Slurp/2.0-OwlWeekly=Yahoo
Slurp/3.0-AU=Yahoo
UltraSeek=InfoSeek
MuscatFerret=WebTop
appie=Walhello
UK Searcher Spider=UK Searcher
teoma_agent1=Teoma.com
HenryTheMiragoRobot=MiragoBot
Lycos_Spider_(T-Rex)=Lycos
Toutatis 2.5-2=Hoppa.com
Hubater=Hubat.com
IlTrovatore-Setaccio=IlTrovatore.it
IncyWincy=IncyWincy.com
Mole2/1.0=Intags.de
MP3Bot=MP3bot.de
LNSpiderguy=Lexis-Nexis.com
kuloko-bot/0.2=Kuloko.com
NetResearchServer=Look.com
MantraAgent=Look Smart
Arachnoidea=EuroSeek
EZResult=EZResult
ArchitextSpider=Excite
ArchitectSpider=Excite
Inktomi=InktomiBot
GAIS Robot/1.0B2=Seednet
Gulliver/1.2=Northern Light
Infoseek Sidewinder/0.9=Sidewinder
lwp-trivial/1.27=Search 4 Free
Lycos_Spider_(T-Rex)/3.0=Lycos
Scooter/1.0=AltaVista
sexsearcher=Sex Searcher
WebCrawler/3.0 Robot libwww/5.0a=WebCrawler
WebCrawler-AddURL/2.0=WebCrawler
WiseWire=WiseWire
WiseWire-Alpha-1.0=WiseWire
WiseWire-Alpha-Spider=WiseWire
WiseWire-Alpha12-Spider971219a=WiseWire
WiseWire-Alpha12-Spider(971223a)=WiseWire
WiseWire-HotSpider-1.0=WiseWire
WiseWire-Spider=WiseWire
WiseWire-Spider-1.0=WiseWire
WiseWire-Spider2=WiseWire
WiseWire-Widow-1.0=WiseWire
WiseWire-Widow-1.0r=WiseWire
WiseWire-Widow-1.0-ALPHA12=WiseWire
AbachoBOT=Abacho
abcdatos_botlink=ABCDatos
AESOP_com_SpiderMan-AESOP.com
Scooter=AltaVista
Mercator=AltaVista
Scooter2_Mercator_3-1.0=Scooter2 Spider
roach.smo.av.com-1.0=Roach SPider
Tv_Merc_resh_26_1_D-1.0=Merc Spider
Wget=All The Web
antibot=AntiSearch.net
Atomz=Atomz
CanSeek/=Can Seek
ChristCRAWLER=Christ CRAWLER
DaAdLe.com ROBOT/=DaAdLe.com
contact/[email protected]=Jylee Spider
RaBot=Daum.net
Agent-admin/=Daum.net
DeepIndex=DeepIndex
DittoSpyder=Ditto.com
Jack=Jack Spider
EZResult=EZResults.com
FyberSearch=FyberSearch.com
GalaxyBot=Galaxy.com
geckobot=geckobot.com
GenCrawler=GenDoor.com
GeonaBot=Geona.com
moget/2.0=goo.ne.jp
JoocerBot=Joocer.com
HenryTheMiragoRobot=Mirago.co.uk
mozDex/=MozDex.com
MSNBOT/0.1=MSN
ObjectsSearch/0.01=ObjectsSearch.com
PicoSearch/=PicoSearch.com
PJspider=PortalJuice.com
DIIbot=PowerInter.net
gazz/1.0=Gazz Spider
NationalDirectory-SuperSpider=NationalDirectory.com
psbot=PicSearch.org
AlkalineBOT=AlkalineBOT
Scrubby/=ScrubTheWeb.com
asterias=SingingFish.com
Kototoi/0.1=Kototoi Spider
Searchspider/=Searchspider.com
SightQuestBot/=SightQuest.com
Spider_Monkey/=Spider_Monkey.ca
teoma_agent1=Teoma.com
ESISmartSpider=Travel-Finder.com
appie=Walhello.com
MuscatFerret=WebTop.com
WSCbot=WorldSearchCenter.com
Yandex=Yandex.com
Yellopet-Spider=Yellopet.com
libwww-perl=Libwww Spider
citenikbot/=CitenikBot
CLIPS-index=CLIPS Spider
cosmos=XYleme.com
Computer_and_Automation_Research_Institute_Crawler
=CARI Spider
DiaGem/=DiaGem Spider
EchO!/2.0=Voila.com
FinaleRobot=FinaleRobot
larbin=Larbin Spider
MultiText=MultiText Spider
OntoSpider=OntoSpider
sherlock_spider=Sherlock Spider
Steeler=Steeler Spider
0.1_hseo(at)cs.rutgers.edu=Rutgers.eduSpider
Zao/0.2=Zao Spider
[email protected]=Xcrawler
xyro=Xyro Spider
WebGather=WebGather Spider
Ad Muncher=Ad Muncher Spider
ADSAComponent=ADSA Spider
ADSARobot=ADSARobot
Albert Indexer=Albert Indexer
AnswerChase=AnswerChase
ASPSeek=ASPSeek
ATA-Translation-Service=ATA Spider
AVSearch=AVSearch Spider
beholder=Beholder Spider
e-sense=E-sense Spider
BravoBrian=BravoBrian Spider
[email protected]=BumbleBee Spider
Checkbot=Checkbot
contype=ConType Spider
Convera Internet Spider=Convera Spider
DaviesBot=DaviesBot
deepweb=Deepweb Spider
EbiNess=EbiNess Spider
EmailWolf=EmailWolf Spider
Excalibur Internet Spider=Excalibur Spider
Expired Domain Sleuth=Domain Slueth
GigaBaz=GigaBaz Spider
GigaBazVStheWeb=GigaBaz2 Spider
[email protected]=BrainBot Spider
Giskard=Giskard Spider
grub-client=Grub Spider
htdig=HT Dig Spider
http://webwarper.net=WebWarper.net
infoGIST=infoGIST Spider
InterGO=InterGO Spider
InternetArchive=Internet Archive
Internet Ninja=Internet Ninja Spider
InternetSeer=InternetSeer
ipiumBot=ipiumBot
InternetAmi IOR=InternetAmi
InsumaScout/=InsumaScout
Katriona=Katriona Spider
larbin=Larbin Spider
LEIA=LEIA Spider
LexiBot=LexiBot
logikabot=LogikaBot
Mister Pix II=Mister Pix Spider
MOSES 2.0 Spider=Moses 2.0 Spider
Mata Hari=MataHari Spider
metabot=MetaBot
NetCruiser=NetCruiser
NPBot=NPBot
NetZippy=NetZippy
NZBot=NZBot
Opencola=Opencola Spider
ORA_checksite=ORA Spider
Onekit.com - PAD File Get.=Onekit.com
Oxxbot1=Oxxbot1
Pansophica=Pansophica Spider
Phoaks=Phoaks Spider
phpMySearch-Crawler=phpMySearch
PICgrabber=PICgrabber
PictureOfInternet=POI Spider
[email protected]=Malfunction.orgr
PintaSpider=PintaSpider
Pita (Chub.Stanford.EDU)=Pita (Stanford.edu)
PitSpyder Thread0=PitSpyder
psbot=PSbot
PolyBot=PolyBot
PureSight=PureSight
Rumours-Agent=Rumours Spider
RepoMonkey Bait & Tackle=RepoMonkey Spider
Robot2.0(PingSoft)=Robot2.0
SilentSurf=SilentSurf
SlySearch=SlySearch
[email protected]=SlySearch.com
SpaceBison=SpaceBison
SpotOn=SpotOn Spider
SQ Webscanner=Webscanner
Squid=Squid Spider
Sqworm=Sqworm Spider
SurfControl=SurfControl
Tagword=Tagword
TaWWWantula=TaWWWantula
Tcl http client package=TCL Spider
TeraCrawl=TeraCrawl
TurnitinBot=TurnitinBot
UCmore=UCmore
UdmSearch=UdmSearch
unlostBot=unlostBot
[email protected]=Unlost.com
URLBlaze=URLBlaze Spider
utopy=Utopy Spider
[email protected]=Utopy.com
UtilMind HTTPGet=UtilMind Spider
UrlScope=UrlScope Spider
Vagabondo=Vagabondo Spider
VCI WebViewer=VCI Spider
vspider=VSpider
WAVETools=WAVETools Spider
Webbandit=Webbandit Spider
Webclipping.com=Webclipping Spider
webcollage=WebCollage Spider
WebCompass=WebCompas Spider
WebGenie=WebGenie Spider
Web Hound=WebHound Spider
Web Magnet=WebMagnet Spider
WebMiner=WebMiner Spider
Webpush=Webpush Spider
WebSymmetrix=WebSymmetrix Spider
webrank=WebRank Spider
webwasher=WebWasher Spider
WhosTalking=WhosTalking
XupiterToolbar=Xupiter Spider
StackRambler=Rambler
rambler=Rambler
oBot=oBot
Aport=Aport
WebZIP=WebZIP
ZunZun=ZunZun
OmniWeb=OmniWeb
ZipppBot=ZipppBot
GetSmart=GetSmart
MarcoPolo=MarcoPolo
PlantyNet=PlantyNet
Ivan Susanin=IvanSusanin
Netprospector=Netprospector
TurtleScanner=TurtleScanner
Yahoo-MMCrawler=Y!MMCrawler
Binky=libwww.Binky
amaya=libwww.amaya
Webgate=libwww.Webgate
W3C_Validator=libwww.W3C_Validator
libwww=libwww.nothing


P.S Некоторые боты могут и не зайти, у Нас и половина отсюда не шастает...


--------------------
Не работает ссылка? Пишите в теме, обновим :)! Link not working? Let us know in the comments, we'll fix it!


Трудно найти слова, когда действительно есть что сказать. Э.М. Ремарк
User is offline
Go topGo end

Topic Options
Сейчас: 29.03.2024 - 2:40
Мобильная версия | Lite версия