I want to write an application to capture data from a website, and the website are using ajax to retrieve data from server.
Is there any solutions that I can get those data conveniently and store into my own database ? As the data in that website is dynamic, historical data will disappear, and I want to keep track them.
Please suggest any solutions, thanks in advance !
Selenium RC can do this with a little bit of work.\
http://seleniumhq.org/
You may try IRobotSoft Web Scraper. Check demos here http://irobotsoft.com/help/ to see if it is what you want.
Related
How can I load the firebase data before Google sees the content?
For example, retrieve data and render it with h1, p and other html tags, but my problem is SEO. I've been watching Gatsby JS but I don't need something like that.
On Firebase, the SEO is called App Analytics and it's possible to disable it on your database. However, you can only disable it generally and not load the data before it starts, once it's activated, it's always working, unfortunately.
I would recommend you to raise a Feature Request for this to be implemented here, so Google can check for further development.
Besides that, in case you want more information about how this is possible, you can check the below documentation.
Disable Analytics data collection
In addition, this question from the Community - How to use Cloud Functions for Firebase to prerender pages for SEO? - there is a case that I believe might help you, since it's about pre-rendering content. This is for another type of use case, but I believe it might help.
Let me know if the information helped you!
Before i start looking down this road i have different datasources that would need to be updated in the same tab if i was to attempt to use react-admin, wondering if i'll be able to modify it to do what i need?
For anyone else who happened to land here and had as little experience as i did when i asked this.... you can use the cloudinary widget in your react-admin app and pass the returned url off to your mutation no problem.
I am working on integrating a 2sxc content WebAPI feed into a ReactJS application.
I have managed to get a JSON feed of data into the application, and am in the process of mapping out the data.
I'm wondering what the best practice would be to "resolve" a URL which is coming through as a DNN Page/ Tab ID.
Below I will showcase the various points this is referenced...
First the Setup of the entity / data types...
Then this is an example entry with the data filled out... The page link / URL is set up to point to another internal page on the DNN website:
Finally you can see this data item come through as a JSON feed via the 2sxc API:
What is the best way to convert this piece of data into a URL which can be used in a SPA type application?
There isn't any "server-side" code going on, just reading a JSON feed on the client side...
My initial idea would be to parse this piece of data in JS, to extract the number then use something like this:
http://www.dotnetnuke.com/tabid/85/default.aspx
http://www.dotnetnuke.com/default.aspx?tabid=85
I was hoping someone with more experience would be able to suggest a better / cleaner approach.
Thanks in advance
If you were server-side in Razor you'd be doing something like this:
#using DotNetNuke.Common
View List
XXXX = Dnn.Tab.TabID or define a string with the tab id you want
I seem to have a vague memory that I saw somewhere that Daniel (2sxc) has a way to use Globals.NavigateUrl() or similar on the client side, but I have no idea where or if I did see that.
The Default.aspx?tabid=xx format will certainly work, as it's the oldest DNN convention and is still used in fallbacks. The urls aren't nice, but it's ok.
The reason you're seeing this is because the query doesn't perform the automatic lookup with the AsDynamic(...) does for you. There is an endpoint to look them up, but they are not official, so they could change and therefor I don't want to suggest that you use them.
So if you really want a nicer url, you should either see if DNN has a REST API for this, or you could create a small own 2sxc-api endpoint (in the api folder) just to look that up, then using the NavigateURL. Would be cool if you shared your work.
I'm new to WordPress and I've also been having fun experimenting with Angular/Firebase.
I'm looking to find a way to have an Angular app connect with the WP API in a way that goes further than just displaying posts.
Can someone direct me towards how to submit a form to Firebase and have it simultaneously create a new post and/or page in the WordPress backend? I've come across Zapier but, a) It doesn't seem to be flexible enough for what I want to do and b) It's not free and I'd rather figure it out on my own (with some help from you guys of course.)
I'm plenty fine with being able to use an $http request to list and display posts... but how can I create NEW posts?
PS: I don't NEED to use Firebase. Mainly, I'm really most concerned with creating a new post and/or comment without having to actually do it from the wp-admin.
im doing a sample todo application by using a tutorial .. In that they are using Backbone.localstorage , my doubt is Where does the data's will be stored when using Backbone.localstorage()?
localstorage will save all of your todos data within your browser, instead of sending them to a server.
-So that when you use Backbone.localstorage() the data is with you in your browser than to store it on server side and will get accessed from browser only
-You may refer the link http://backbonejs.org/
Do you want this?
I'm taking this on http://todomvc.com/architecture-examples/backbone/
Want to know what is localstorage indeed?
See it in your computer:
C:\Users\YourUserName\AppData\Local\Google\Chrome\User Data\Default\Local Storage
You will find
http_todomvc.com_0.localstorage
If you try to edit the file with your notepad, you will find it's a sqlite3 datebase indeed.