I want to know how is the Mozenda Screen Scraper coded?
http://www.mozenda.com/screen-scraper
I shows a browser where user can select the fields he wants to scrap and it creates a crawl script out of it.
The crawl script generation part is clear to me, I want to know does it record the user actions which the user is doing in the browser.
I want to do something similar using C#.
I guess they run something like iMacros on the backend. I even noticed the iMacros browser icon in some of their screenshots ;-)
If you want to code something like this yourself in C#, the IE webbrowser control is the best starting point!
#yc08m, I can tell you for sure that they are not using iMacros. It is all coded with their own proprietary code.
I realize this is an extremely outdated post, but they seem to rely heavily on XPath, so first things first you would need to load the page into an object that you can query. I'd recommend using something like Html Agility pack to accomplish this.
Related
I am not very familiar with HTML and web development, so sorry for my wording.
I am wondering why I face such an weird situation for me. I want to save a webpage with some form where there are some dropdown lists to choose the answer. The purpose is to make a "screenshot" of that page, but to make possible to see what are the options in the dropdowns.
So my idea is to save a page as a single file .mhtml in Chrome. The questions look like this:
But when I saved the page as .mhtml the file looks like this:
But the main purpose is to see the dropdown list in the file (so in this example list of months).
It nearly works in IE, but the outlook is different. And I am nearly sure that sometimes it doesn't work, but I have no idea why:
Do you have any advice how to workaround that?
I am trying to spin up a web application but Im having a really small problem and Im not sure how to handle it. I have did it before a long time ago but forgot (CLUTZ). When I try to access my application I see the login screen but it looks cached. I see a white page and I can see the links. The layout doesn't load for some reason. Like I said, this is a very small issue that I know someone can assist me with. If you give an answer please explain so that I can learn from it. Thanks a mil!
It sounds like what you're describing is CSS not loading. Doublecheck your <link href="…" rel="stylesheet"/> tags to ensure that they're pointing to the correct files.
well i've made a responsive website which handles well in mobile devices. Now there are some Phonenumbers on the website which my cliënt would like to be clickable on any Phone so the visitor can call directly. I found that making a link of the phonenumbers works like so:
make a call
This triggers mobilephones to call the number. But it also triggers the webbrowser on any other device to follow the link, which results in "page can't be found"
I'm looking for a good anwser to tackle this problem. I've been searching for a while now but i'm getting a bit tired and frustrated.
I think i've come with a solution but i don't excactly know how to put this in the html.
There are several ways to conditional comment browsers in html. If i could do this with the link part and rule it out:
<!--[if any **none mobile** webrowsers: don't read:]>003164646464
And all mobile browsers read the link.
It seems to me, that this is the most easy way to do this, but i could be wrong...
I hope that someone can give me any pointers, I really appreciate your idea's and help!
THANKS!
There is no easy way to achieve this. You can use different approaches depending how accurate you want to be:
WURFL - most accurate, allows to check user-agent and get browser / device capabilities
You can try parsing user-agent by your own detecting OS - check this answer Detecting a mobile browser
Use css media queries to target devices with small screen
Unfortunately there is no silver bullet for this (at least I don't know one).
I'm pretty much totally lost.. I've posted twice on the smartclient forums and gotten no help so maybe the people here are more friendly than their own staff. (it really bothers me but they appear to have the best software for what I'm trying to do)
I'm trying to wrap my head around how I would get one of their examples (the demo showcase ones which I have downloaded etc) on my web host, just to see how it works/play with it, but I couldn't find any forum guides or videos etc on this (documentation is really abysmal for people that don't speak code yet).
Is there some special back-end I need on my web host? Where can I go to figure out how to link the stuff together? Do I have to compile something using java.. etc.
I'm used to just editing stuff in notepad++, uploading it, and hitting refresh, but I'm guessing smartclient isn't that simple, or is it? (I'm just going to use it to make tables from excel spreadsheets that I can filter through, that's it, no fancy application).
Sincerely,
Mr. Totally Lost.
Everything is covered by the guide (page 6) : http://www.smartclient.com/docs/8.2/docs/SmartClient_Quick_Start_Guide.pdf
SmartClient embed everything needed, you will only need a valid JDK installation and the zip provided in their website.
I have a GWT-FormPanel on my website, where people can upload pictures and answer some questions. It's working very well. The only problem is: I would like to provide a feedback to the user (for example: 0% to 100%) during the actual file process. But I have no idea how I can do that. I think that's a very common issue, that's why I would like to ask you guys if you know any tutorial or example that could help me to solve this problem.
I've already tried GWTUpload, but it does not do what I want: I have a submit button at the end of the FormPanel and the GWTUpload has it's own "SEND" button, which I don't want to have.
Thanks in advance for helping and merry Christmas!
From your problem statement you mean to say that you want to provide the progress bar while uploading file starting from 0 to 100%.
Take a look to this library: http://code.google.com/p/gwtupload/. This will may solve your problem.And it is also working well in all browsers and also on Linux,Mac.
Looks like GWTUpload allows to use custom submit button. Haven't tried it so maybe i'm wrong.