|
lionel
Neophyte
China
1 Posts |
 Posted - Dec 20 2004 : 09:25:25 AM
|
Need help with software development?
consulting and outsourcing marketplace, where you can post your project free and receive bids from a global pool of knowledge workers and service providers.
I'm a spammer and I'm stupid.
|
|
|
VBBR
Moderator
Brazil
617 Posts |
Posted - Dec 20 2004 : 10:12:32 AM
|
...wait.
I think that if VBGamer wanted advertising in the website, it could use Google or something like that. Or am I wrong?
Did the staff authorize that?
|
Whatever. Who knows... |
Edited by - VBBR on Dec 20 2004 10:16:04 AM |
 |
|
|
Eric Coleman
Gladiator
USA
811 Posts |
Posted - Dec 20 2004 : 3:46:17 PM
|
| this is probably just a bot of some sort. I guess it's stime to start locking down different areas of the website. |
|
|
|
VBBR
Moderator
Brazil
617 Posts |
Posted - Dec 21 2004 : 05:02:25 AM
|
Shouldn't the topic be deleted? We're advertising it yet more by replying.
And what about the "numbers-and-letters-mixed-with-lines-so-a-bot-can't-register" approach?  |
Whatever. Who knows... |
|
|
|
Eric Coleman
Gladiator
USA
811 Posts |
Posted - Dec 21 2004 : 09:59:59 AM
|
I'm not sure what kind of software I would have to install on the server to do stuff like that. Instead I was thinking more along the lines of a simple test. A few questions with multiple answers. Bots aren't smart enough to understand language yet but the questions would be obvious. What is two plus 2? A couple of answers could be 2, two, 4, etc. Or maybe something like E=mc^2? The answers could be Albert Einstein, George Bush, Your mother.
I removed the link from the post above. I think we can continue this post on how best to defeat spam bots. Lately VBgamer is being crawled very heavily by search engines. MSN, Inktomi, and Google are really big sources of bot traffic, but there are lots of other bots though. I suspect they're mostly email harvesters.
|
|
|
|
VBBR
Moderator
Brazil
617 Posts |
Posted - Dec 21 2004 : 11:31:31 AM
|
You could display a simple picture of a circle, square or triangle (randomly), then ask the user "What is that?" -> "A circle" / "A Square" / "A Triangle" / "None of the above".
Maybe the 5th option could be "I'm a bot". |
Whatever. Who knows... |
|
|
|
Krisc
Knave
69 Posts |
Posted - Dec 21 2004 : 5:35:52 PM
|
I think it might even be enough to just create a "Click yes to verify you are not a bot..."
|
|
|
|
Almar
Moderator
Netherlands
192 Posts |
Posted - Dec 22 2004 : 06:53:42 AM
|
The MSN bot is horrible. It downloaded about 80 times YALG before I noticed the download logs (yes, I keep track of all downloads on my site, just for stuff like this). It's like 800mb. Not that Icare that much (800mb isn't really much), but it would simply have continued for weeks and months. If you search on some of the IP's eric, you can find some info on most bots, and possibly a) ban them or b) use robots.txt (which is ignored anyway by most search engines, imo)
I'm simply returning an error from the download counter script, if the IP matches the MSN bot one. |
|
|
|
Eric Coleman
Gladiator
USA
811 Posts |
Posted - Dec 22 2004 : 11:15:34 AM
|
Here are some interesting graphs. The numbers at the bottom are Month / Day /Year. The graphs show daily activity for 2004.
This shows browser referrals. Most people come from google. Practically 0 people are coming from either the Yahoo or MSN website. VBgamer aparently doesn't rank very high with them.
Download Attachment:  Daily_Search_Engines.png
9.42 KB
This shows the spider or bot's daily activity. Around Aug 1 is when bot activity dramatically increased. Google has the highest hit count for a single day.
Download Attachment: Top_Spiders.png
5.76 KB
However, if you look at this graph, you can see that overall the MSN robot is more active than either Google or Yahoo(Inktomi Slurp is Yahoo).
Download Attachment: Daily_Spider_Activity.png
7.77 KB
What's interesting about all this is comparing bot activity versus the number of hits from those search engines. Google brings in the most hits, so it's robot activity is somewhat usefull. MSN downloads lots of stuff but no one ever finds vbgamer by searching with MSN. By comparing pages downloaded to search engine referrals we get the following ratios:
Google: 1.4 pages downloaded for every referal
MSN: 98.7 pages downloaded for every referal
Yahoo: 16.9 pages downloaded for every referal
MSN just sucks! |
|
|
|
VBBR
Moderator
Brazil
617 Posts |
Posted - Dec 22 2004 : 4:36:09 PM
|
I think we're getting more MSN bot hits because the MSN search system is being re-created or something (they say to better it), so I think it needs to crawl everything again.
Anyway, Google rocks. |
Whatever. Who knows... |
|
|
|
Almar
Moderator
Netherlands
192 Posts |
Posted - Dec 23 2004 : 02:45:18 AM
|
| Yeah, I read somewhere the MSNBot is quite aggressive :) |
|
|
We hate spammers
Daily_Search_Engines.png
Top_Spiders.png
Daily_Spider_Activity.png