How to scrape an infinite scrolling webpage ? - screen-scraping

I have a project in my college for that I need to scrape data of the user comments from this stocktwits page.
But as it has infinite scrolling I am not able to drill down till the bottom

Related

Performance issue of flatList in Ext JS

I am facing a issue while trying to update scroll fast in my application. Screen became blank while scrolling fast.
I have added video link.Issue Video
I was trying to make smooth render on contact list but adding 50 per conacts scroll blank space was coming.

Why does window.scrollTo() work in chrome on my react site but not in Firefox?

I have a React website here: www.assertivesolutions.ca.
If you visit the site in Chrome and scroll down to the "What We Do" section and click on the "Our Services" button, you get taken to the Our Services page. Notice is starts further down on the page and scrolls up to the top. This is because, as an SPA, it doesn't really go to a different page; it stays on the same page and just changes the content. So if you're scrolled half way down the page before you click the button, it will still be half way down the page after you click the button. So I implemented a fix to scroll to the top in the componentDidMount() hook:
componentDidMount() {
window.scrollTo(0, 0);
}
However, if you try the same thing in Firefox, it does not work. It stays scrolled half way down the page.
So I can take two approaches to solving this:
Figure out how to get scrolling to work in Firefox.
Figure out a different way of making sure the Services page loads at the top other than using window.scrollTo(0,0).
I'm leaning towards 2) because I have to imagine there must be a way in SPA websites to accomplish what I want.
Does anyone know how I can accomplish either 1) or 2) (preferably 2).

Why components disappears and reappears while fast scrolling

Here is the link of the website https://ecom-website-f483.vercel.app/ after website homepage is completely loaded and then if you scroll little faster you will start seeing blank screen and after few milliseconds component appears again.

Starting a "3 page" Single Page Website on the "2nd page" in ReactJS

So I've started getting the hang on ReactJS and have built myself a basic Single Page Website (SPW?).
It currently is 1 "page" (really just an area which spans the whole screen) with the ability for the user to scroll down to the second "page" by clicking a button (or just scrolling).
Now what I need to do is give the user the ability to scroll up as well... to another "page".
Content Area 1
↑
LANDING AREA (user must be dumped here on initial load of the site)
↓
Content Area 2
I hope this makes sense?
EDIT: Apologies for the incorrect use of "SPA"... I've since learned the difference between that and a single page website.
A "single page app" doesn't mean you literally have all of the content on one page. You can have different "pages", however loading them won't cause a page refresh because they're not new html pages served up by the server. You should look into React Router if you want people to be able to navigate to different "pages" in your SPA, otherwise you can look into window scrolling so that you can move up and down.
According to my understanding you are trying to build one page website where each content section you linked with internal page linking & added button for the users to scroll top/bottom. It's not single page application. It's single page website. But, for learning curve it's good to start.

Angular Chart ignore scroll page behaviour

I'm using angular-chart (http://jtblin.github.io/angular-chart.js/) to make a single page application with differents chart.
The page could be scrolled to see all charts.
I had a problem with the behaviour of the browser after data refreshing (using asynchronous call to restfull services): the page is scrolled up or down automatically, depending on the "last" response obtained from the services.
My aim is:
- if I am in the middle on the page, I want to stay on the middle of the page
- if I am in the top on the page, I want to stay on the top of the page
- if I am in the bottom on the page, I want to stay on the bottom of the page.
Can someone suggest me any solution to avoid this scrolling (to disable/ignore this scrolling)?

Resources