As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 12 years ago.
I want know which programming language provides good number of libraries to program a web bot?
Something like crawling a web page for data. Say I want fetch weather for weather.yahoo.com website.
Also will the answer be same for a AI desktop bot?
Here is how you could do it in Python:
from urllib2 import urlopen
from BeautifulSoup import BeautifulSoup
soup=BeautifulSoup(urlopen("http://weather.yahoo.com/").read())
for x in soup.find(attrs={"id":"myLocContainer"}).findAll("li"):
print x.a["title"], x.em.contents
Prints:
Full forecast for Chicago, Illinois, United States (Haze) [u'35...47 °F']
Full forecast for London, Greater London, England (Light Rain) [u'43...45 °F']
Full forecast for New York, New York, United States (Partly Cloudy) [u'42...62 °F']
Full forecast for San Francisco, California, United States (Partly Cloudy) [u'51...70 °F']
I don't know if it is the best, but Python is definitely pretty good and simple for that.
Another good python library for screen scraping and web crawling is scrapy.
Related
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I have to develop an online store that sell the access to some rest api. I'm not a Drupal developer, where I can find good resource or open source project to study?
Ubercart is best module to develop online store with drupal.
Please find the helpfull links for integration and development.
1. http://www.ubercart.org/docs
2. http://www.freelancedrupaldeveloper.ca/ubercart-tutorial-part-1
Also you can use Drupal Commerce.
Link :- http://chicago2011.drupal.org/sessions/drupal-commerce-setting-shop-drupal-7
Cheers!!!
Übercart, open source Drupal based e-commerce project, helps you to develop online store, also supports D7. http://ubercart.org
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
Is it good to build a high traffic sites using CakePHP? I am using CakePHP for several projects, but they're very low traffic. Any examples of such site or how can I improve the performance?
This video probably sums up the answer for you (and gives a lot of good details / information) on "CakePHP at massive scale on a budget"
It talks about how they use CakePHP on VERY HIGH traffic site, how it worked, and how it ran...etc.
I believe it was on 1.2 or 1.3 as well, which is significantly slower than 2.0, so - yes - CakePHP is a completely valid option for high-traffic sites. Obviously sites like Facebook will have their own lighter, in-house framework, but - I think that's a problem not worrying about until you reach that point (and by then you'll be a millionaire anyway and won't care) :)
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 9 years ago.
Amazon did a great job by providing an online calculator for AWS; resides here:
http://calculator.s3.amazonaws.com/calc5.html
Which really helps to find your way among a swarm of cloud options.
Is there similar a tool for GAE (Google App Engine) or Microsoft Azure?
Microsoft will have a calculator and other tools around PDC.
newdesic has a tool that you can use - http://azureroi.cloudapp.net/
Not that I'm aware of. Of course, lacking tiered pricing, calculating costs for App Engine is very straightforward - just multiply expected usage by cost-per-unit for each of the 5 dimensions.
There is an unofficial billing calculator for Google App Engine.
I tried this diagnostic tool which seems good for making an estimation:
http://www.whitestratus.com/cloud-platform-diagnostic-tool
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
I use Safari Books Online as a reference library and to evaluate book before I decide to buy a paper copy, but it doesn't include any Apress books. Is there a better alternative you would recommend?
Edit: Safari Books Online now includes Apress titles which makes it the most complete reference library on the web in my opinion.
With my ACM membership, I get access to both Safari and Books24x7 (this includes Apress).
The selection is reduced from the total offering of those sites (600 in Safari only available to professional members and 500 in Books24x7 available to both student and professional members), but I find it's well worth the ACM annual membership, especially when you factor in the other benefits.
There is a discount for first year members: http://learnmore.acm.org/joinacm5.html
Our local library (nutrias.org) does have ebooks for free also, but I haven't looked to see if they have technical books. In addition, they are term-limited with DRM (yuk).
I use paper books and use Amazon as a reference
Cade,
Not the answer you are looking for but if you are paying for Safari check around your local library systems and make sure you cannot get it for free.
Here in Santa Clara county, California, we can access the library e-resources, including Safari, from the library's website.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I am just finishing up an Artificial Intelligence course where, as part of the assignments, I was able to program bot in a multi-player environment (BZFlags).
What I was able to do was to program the bot to interface with the world and play capture the flag against other bots or even humans.
What I would like to know is, what other environments are out there where I could do the same thing (programming bots for a game or in a specialized environment)?
I was able to do this with BZFlags because they ad an API provided so that I could send commands to my bots and find out information about the world around them.
There's Robocode and NRobot.
In RoboCode, you use Java to program your Robot's AI, and then unleash him against other Robots and see how he does. NRobot is the .NET version of a very similar idea.
RobotBASIC is similar.
another, possibly interesting thing to look at is SoccerFun but it is in Haskell and it's about programming cooperative bots
How I Built a Working Poker Bot describes some of the process of building a poker bot. The author states "And if I can build one, well. Anybody can build one." I found this by way of this posting.