How can i scrape google reviews with details and owner comments and store in csv? - screen-scraping

Scraping google reviews
I need it in csv with name, number of reviews, review text and owner text.

Related

How to structure Firestore database for followers/following

I have an app where users can follow each other and I currently have a database structure which allows users to follow, unfollow and see their followers/following users, and see the number of followers/following they have.
The way I have structured my database is by having a users document stored in a usernames collections which contains their followers/following count, and all their info. Like profile image and display name etc.
Then, this users followers/following users are stored in a subcollection as a document. In this document, there is a document reference which points back to the root usernames collection, and to the following/followers users document, where i then pull their info if needed.
I was just wandering if there is a more efficient way to structure my database. This seems like the best option but I have a feeling their is an even better way which i am not thinking of.
Thank you

AlchemyAPI call to ingest news by URL

I use the AlchemyData News API to search for news articles by category to receive sentiment and company information.
Is there a way to instead of searching for an article, to feed an Article URL or headline to the service to have the article ingested to get sentiment and company info?
You want to use the AlchemyLanguage API, specifically the entity extraction feature, to get this type of information about a specific article or body of text.
For example, you can issue

Wordpress user registration to upload data for admins approval

I want that users be able to upload info, this info will be show on a product list but it will only be posted if the admins approve it.
The user may need to register or not, the contact info will be on the info they upload.
Do i need to storage the info on a different database? can i do this with the wordpress registration?
You can use wordpress database table user to store data, set post_status as 'pending', so that admin can check and can change its status to 'publish'
You can create custom template page, then insert user data in post table using custom query or
wp_insert_post() function.
Hope this helps.
Cheers!!!!

Store utm source from url to database when user signup

I would like to keep the utm source data when a user visit my site via the url with utm source in order to see the efficiency of any source.
url example : http://www.mydomain.com/?utm_source=facebook&utm_medium=promoted&utm_campaign=welcome
I need to see the users who have been signed up from which source. The best is to keep the utm_source data in a column at users table in database.
I could not succeed to catch and insert the source data if the visitor signs up in that session. My site is php.
Any help will be appreciated.
You should look at the __utmz cookie (automatically created by the Google Analytics tracking code) for all the "utm" related information. In PHP it should be: $_COOKIE['__utmz'].

Database scheme for user logging with different accounts

currently I need to provide web site logging for different social accounts (facebook, google, twitter and so on).
I know that stackoverflow has same system and I wonder if there is stackoverflow database model in public access. So I can find right way to store user data in my db.
Currently I have next problems.
So, I have my table for users:
UserID
UserName
RegistrationDate
Email
Rating
For users who create account with web site form I use next additional info:
Password
FirstName
LastName
Avatar
I stock in question how to store data for users who login with social networks and what should I store.
It seems that I dont need to store facebook name, surname and so on. I thought about getting it with js on pages where I need it.
Also I am thinking how to provide user with adding facebook, twitter references and so on for his profile.
P.S.
I am using DotNetOpenAuth for user authentication via social networks. Working with asp.net MVC 3.
About functionality on my web site:
just adding articles and rating for user.
For comments I use https://disqus.com/.
Ideally, you should have two tables. One for Users and one for Identities. In the Users table, you store things like your application user id, name, emails, etc. In the Identities table, you link back to the person in the User's table, but have a 'network' field that says which network the Identities row is for (e.g. Facebook, Google, Twitter, etc).
The Identities table can store the User ID and details specific to that platform, e.g. User_ID for Facebook, Twitter username, etc. The user will have one entry in the Users table, but can have many entries in the Identities table, depending on how many networks the user has connected with.

Resources