Upflex

upflex

, one of the most popular Vue frameworks, has recently released a new image optimization module, which allows developers to easily optimize images within Nuxt without having to install additional third-party libraries. Nuxt imgix is happy to be one of the first image providers to work with the new Nuxt Image Component. This article will show you some great examples of how you can set up and use these transformations with . <nuxt-img> Why Automate Image Optimization? Images constitute an average of on modern websites. They have an outsized impact on user experience and website performance. The scale and complexity of image processing are growing faster than ever as more user-generated content such as NFTs started to enter the picture. 75% of the total page weight Automating image optimization is no longer optional for any web development team for the following reasons: Images that aren’t optimized for a user’s device or browser can create a poor viewing experience and a negative perception of the website. Unoptimized images can slow down a website and hurt its SEO results. An expanding image delivery pipeline can significantly increase the bandwidth costs and the stress on the infrastructure. Why Use imgix? You might be initially wondering, why should I use , let alone use it with the Nuxt Image component? Nuxt is already including an open-source module to optimize my images. Yes, the IPX instance included with Nuxt Image is a good module to help optimize locally hosted images. imgix Here are some great reasons why you should use imgix instead: imgix empowers developers with 120+ API transformations for their images. Using an open-source image module would increase your build time with Nuxt, since the images are being processed during the build. imgix can also simplify your asset management needs. We connect to wherever your images are stored, like an Amazon S3 or GCS bucket, and we will provide a UI or API to easily organize and access those images. imgix includes global CDN delivery with a custom Fastly instance. imgix has a free plan. If you are working on a small project, you can access all the imgix features with that ! free plan This will certainly supercharge your website beyond what is initially offered with the IPX instance. Getting Started with imgix If you already have an account with imgix, move on to the Installation steps section. If you need an imgix account, you can sign up for a . Once signed up, you will need to set up a source and choose your imgix domain. Once your source is set up, you can either start serving images that are currently in your storage with your new imgix domain, or you can upload new images as well. You can find more in-depth instructions on the as well. free account here imgix setup page Installation steps In order to use the Nuxt Image Component you will need to install it in your already created Nuxt project. If you would like to see the complete installation instructions, you can view them on . Nuxt's Website In these instructions, I am assuming you already have an existing Nuxt project, or you have recently created one, that is going to be statically hosted. First, you will need to install the Nuxt Image component: npm install -D @nuxt/image Then, you need to add the newly installed to your : devDependency nuxt.config.js export default {
  target: 'static',
  buildModules: [
    '@nuxt/image',
  ]
} Then, you will need to configure an image section in the nuxt.config.js with your imgix domain: image: {
    imgix: {
      baseURL: "https://assets.imgix.net"
    }
  }, Using the Tag with imgix <nuxt-img> You can now replace tags with tags. You would select the imgix, add the image path name to the src tag, and then have the ability to add additional props to further optimize your images. <img> <nuxt-img> Here is a typical example that you can also find in the Nuxt Image documentation: <nuxt-img
  provider="imgix"
  src="/blog/woman-hat.jpg"
  width="300"
  height="500"
  fit="cover"
  :modifiers="{ auto: 'format,compress', crop: 'faces' }"
/> This would result in a 300 x 500 image, that has optimized the format depending on a browser, is automatically being compressed, and intelligently cropping to the face of the image. Here is the resulting URL: https://assets.imgix.net/blog/woman-hat.jpg?w=300&h=500&fit=crop&crop=faces&auto=format,compress Creating a Responsive Design with Nuxt Image A more complex example would be using the sizes attribute to build out a responsive design. If you would like to create an image gallery, that is set up as columns and uses a responsive design to become full width on mobile, you can actually pass this in the sizes attribute and Nuxt will generate the appropriate size image for each media width. Adding something like this would generate a responsive in an image tag: srcset <nuxt-img
  provider="imgix"
  src="/blog/woman-hat.jpg"
  fit="crop"
  sizes="sm:100vw md:100vw lg:50vw xl:33vw"
  :modifiers="{ auto: 'format,compress', crop: 'faces,edges', ar: '1:1' }"
/> A good tip here, even though my small and medium sizes are going to both be 100vw, you should enter them both. The more size options you add, the more sizing options that will be available in your resulting srcset. Also remember, with imgix, you have an unlimited amount of renders with all of your images, so there is no reason why you shouldn't include many resizing options to ensure you always have the best size image being loaded on your website. You might have noticed some additional items that I included in the modifiers compared to my first example. I added an to the modifier. This will crop all of my images to a square. You might at first be concerned that I am going to crop all of my images. I have actually also modified my crop request to be . ar: 1:1 faces,edges So if an image is not a square and I end up cropping portions of the image, I will ensure that I do not crop out any faces. If there are no faces, then the image will focus on the prominent edges in the picture as well. Here is an example of the resulting image tag from the above : nuxt-img <img 
  src="https://assets.imgix.net/blog/woman-hat.jpg?auto=format,compress&amp;crop=faces&amp;ar=1:1&amp;w=397&amp;fit=crop"
  sizes="(max-width: 640px) 98vw, (max-width: 768px) 98vw, (max-width: 1024px) 49vw, 31vw"
  srcset="https://assets.imgix.net/blog/woman-hat.jpg?auto=format,compress&crop=faces,edges&ar=1:1&w=627&fit=crop 627w, https://assets.imgix.net/blog/woman-hat.jpg?auto=format,compress&crop=faces,edges&ar=1:1&w=753&fit=crop 753w, https://assets.imgix.net/blog/woman-hat.jpg?auto=format,compress&crop=faces,edges&ar=1:1&w=502&fit=crop 502w, https://assets.imgix.net/blog/woman-hat.jpg?auto=format,compress&crop=faces,edges&ar=1:1&w=397&fit=crop 397w"
> You can see that it has generated four different versions in the , each with a different size. This allows the browser to choose an image that is closest to the rendered resolution of the image. This helps to ensure you have many image options to be loaded for a good responsive design. srcset Furthermore, since we are using , imgix will automatically choose the best image format based on the viewer's browser. auto=format Tutorial In this tutorial, I am going to be creating a simple image gallery in a Nuxt project. I will also be using Tailwind CSS and deploying this site on Vercel. The image gallery will be a flex design, with 3 columns on the largest screen sizes, 2 columns on the smaller desktop sizes, and 1 column on mobile sizes. The images will be using the Nuxt Image component and will contain a responsive design. If you would like to skip the tutorial and go right to the code, you can see that on . Github Please start by and then installing the Nuxt Image Component as I explained at the beginning of this blog. When initiating the Nuxt project, I would suggest choosing Tailwind CSS, since my examples will be using this module for CSS. initiating a Nuxt project Once that is all set up, go to your index.vue file in your pages folder. Erase what is currently there and start fresh with a div tag. Like this: <template>
  <div>
  </div>
</template> You can add some sections for a headline and text at the top of your page. Here is an example of adding this with some Tailwind CSS: <template>
  <div>
    <h1 class="title-font sm:text-4xl text-3xl m-4 font-medium text-gray-900">Example using the Nuxt Image Component</h1>
    <p class="m-4 leading-relaxed">Optimize your images with imgix in your Nuxt Image Component.</p>
  </div>
</template> Next, we can focus on adding a flex div to include your images and the tag. nuxt-img <template>
  <div>
    <h1 class="title-font sm:text-4xl text-3xl m-4 font-medium text-gray-900">Example using the Nuxt Image Component</h1>
    <p class="m-4 leading-relaxed">Optimize your images with imgix in your Nuxt Image Component.</p>
    <div class="flex flex-wrap">
      <nuxt-img
        provider="imgix"
        src=""
      />
    </div>
  </div>
</template> Now we can add as many images inside of the flex div as we would like for our gallery. For the next code example, I will focus on just the tag. <nuxt-img /> <nuxt-img
  class="float-left p-2 m-auto w-full lg:w-1/2 xl:w-1/3 2xl:w-1/3"
  provider="imgix"
  src=""
  sizes="xs:98vw sm:98vw md:98vw lg:49vw xl:31vw 2xl:31vw"
  fit="crop"
  :modifiers="{ auto: 'format,compress', ar: '1:1' }"
/> I have included in 2 places info about the sizing that will help my responsive design. First, in the class section. Again, just a reminder, this is an example of using Tailwind CSS. If this is your first time encountering it, I really do suggest checking out their . On XL and 2XL size screens, the images will be viewed in css at 33% the size of the screen. documentation Between 1024 px and 1280 px size screens, the images will be viewed in css at 50% the size of the screen. Then any screen smaller than 1024px wide will be viewed at 100% the size of the screen. I have also replicated this same idea in the attribute, which tells the Nuxt Image Component to generate resized versions for each of these scenarios. sizes Now, you can go ahead and create as many of these tags as you need for your gallery. If you are going to pass image URLs from data or an API, you can easily use the v-for attribute as well. I do believe this is one of the more powerful aspects of Nuxt, so I will go ahead and add 6 image names in my Data section and pass them as a v-for. This could also be a great time to use the Image Management solution included with your imgix account to find the appropriate images you would like to use. <nuxt-img> For my list of images, they are conveniently named 1 through 6, so I will place them in my section of my : script index.vue <script>
export default {
  data() {
    return {
      images: [
        '/artsy/1.jpg?',
        '/artsy/2.jpg?',
        '/artsy/3.jpg?',
        '/artsy/4.jpg?',
        '/artsy/5.jpg?',
        '/artsy/6.jpg?'
      ]
    }
  }
}
</script> I can now access these images using a v-for in my . In order to do that, here is how I am modifying my tag: <nuxt-img> <nuxt-img
  class="float-left p-2 m-auto w-full lg:w-1/2 xl:w-1/3 2xl:w-1/3"
  v-for="(image, index) in images"
  :key="index"
  provider="imgix"
  :src="image"
  sizes="xs:98vw sm:98vw md:98vw lg:49vw xl:31vw 2xl:31vw"
  fit="crop"
  :modifiers="{ auto: 'format,compress', ar: '1:1' }"
/> This will loop through my 6 images, creating a responsive img tag for each of them in my gallery. This is a rather simple idea of using a v-for, but hopefully gives you the idea of how quickly this can be used on a large number of images. Deploying Your Nuxt Project I will be pushing this project up to Github using Github Desktop. Once you have pushed your project to Github, you can then deploy it. For this example, I will be using Vercel. One thing I do to ensure my Vercel builds go smoothly with Vercel is to create a vercel.json file and add a builds section. Mine looks like this: "builds": [
        {
          "src": "nuxt.config.js",
          "use": "@nuxtjs/vercel-builder",
          "config": {}
        }
    ] If you would like to go one step further with an advanced item the Vercel works well with, it would be setting up on these images. Client Hints will tell imgix the exact width and dpr of an image in a Chrome browser, allowing imgix to provide the perfect size every time. This solution only works with Chrome browsers, but it's a great item to still use in conjunction with another responsive set up like this. Client Hints If you look at the documentation, you might notice a warning about Chrome not supporting sending Client Hints to third-party origins. Well Vercel solves that by confirming the routes and feature policy in the vercel.json file, so it is no longer a third-party origin. Here is what you add to to vercel.json file: "routes": [
  {
    "src": "/*",
    "headers": {
        "Accept-CH": "DPR, Width, Viewport-Width",
        "Feature-Policy": "ch-dpr https://assets.imgix.net 'self'; ch-width https://assets.imgix.net 'self'; ch-viewport-width https://assets.imgix.net 'self'"
      }
  }
] In the place of the imgix domain I am using for this example, enter your imgix domain. Finally, I used the Vercel for Github integration, which quickly launches my website from an repos in my Github account. Here is a link to the completed page: https://nuxt-image.vercel.app/ Conclusion This is a pretty simple tutorial example of how you can use imgix with the new Nuxt Image Component, but I hope it has been helpful for you. It is a really simple way to create a responsive design directly inside Nuxt while also getting access to a very powerful image solution from imgix. If you would like to see more advanced versions of this tutorial, or possibly examples from other data sources like a headless CMS or other API, we would love to hear all of your requests. Please don't hesitate to reach out to us on . Twitter To learn more about imgix, check out our or . documentation try it free Also published . here

Automatic Image Optimization Using the Nuxt Image Component with imgix

The Amazon product reviews page shows important information to customers because it provides insights into the quality and performance of products. However, it is difficult to scrape when you need login access. But tools like are useful to scrap data behind a login. Puppeteer This tutorial will show you how to scrape an Amazon product review behind login, parse the raw data, and export the reviews as CSV with a screenshot using and . Node.js Puppeteer Prerequisites Before you begin, make sure to install the following: Ensure you have Nodejs installed on your computer NodeJs: This Node library allows us to navigate the Amazon website, log in, and extract review information from the product page. Puppeteer: This library exports the data to a CSV file. Papaparse: You need an Amazon account to access the product review page. Amazon account: 1: Get Access to the Public Page This step involves retrieving the full HTML of the Aamazon public page. This HTML contains all the data displayed on the page, and you can access it by using Puppeteer to automate web interaction, which means you can automate the actions of a Chrome browser without having to launch it. Amazon public product page URL: https://www.amazon.com/ENHANCE-Headphone-Customizable-Lighting-Flexible/dp/B07DR59JLP/ Now that you have the URL, the next thing to do is write a Nodejs script that will retrieve the HTML content of the page above. Create a new folder for your project and initialize a Node project. Open your terminal and run the command below. Mkdri amazon-review
cd amazon-review
npm init -y This will create a package.json file for your project. Import the Puppeteer library. const puppeteer = require('puppeteer'); Set up a headless browser instance. (async () => { const browser = await puppeteer.launch(); const page = await browser.newPage(); This starts an asynchronous and await javascript method, launches a headless Chromium browser using Puppeteer, and assigns it to a variable. browser The browser variable will call the page function will create a new browser page (This means a single tab in the browser) Navigate to the product page using the page.goto() function await page.goto('https://www.amazon.com/ENHANCE-Headphone-Customizable-Lighting-Flexible/dp/B07DR59JLP/',{ timeout: 60000 }
); This navigates to the URL added as an argument in the goto method. Sometimes, if the page is big and has a lot of information, it takes longer to load. For this tutorial, you will add an option to the method to increase the timeout limit and give the page more time to load. page.goto() { timeout: 60000 } You increased the timeout to 60 seconds (60000 milliseconds). Extract the full HTML content of the page const pageContent = await page.content(); This method returns the full html source code of the specified page and assigns it to the variable. page.content pageContent . Output the HTML content in your console console.log(pageContent); This logs the HTML content to the console, which allows you to view the raw HTML. Close the browser This closes the browser instance to free up space and resources. await browser.close(); Complete code (async () => {
const browser = await puppeteer.launch();
const page = await browser.newPage();

// Navigate to the product page
await page.goto(
"https://www.amazon.com/ENHANCE-Headphone-Customizable-Lighting-Flexible/dp/B07DR59JLP/",{ timeout: 60000 }

);

// Retrieve the full HTML content of the page
const pageContent = await page.content();

// Output the HTML to the console
console.log(pageContent);

// Close the browser
await browser.close();
})(); Example HTML output 2: Scrape Behind the login This web scraping method allows you to extract data from a website that requires login access. In this section, you will use to automate filling in your Amazon login details ( and ) and click the login button. Follow the steps below: Puppeteer email password Login into your Amazon account This instructs the Puppeteer to navigate to the Amazon login URL await page.goto(
"https://www.amazon.com/ap/signin?openid.pape.max_auth_age=0&openid.return_to=https%3A%2F%2Fwww.amazon.com%2Fcart%2Fadd-to-cart%2Fref%3Dnav_custrec_signin&openid.identity=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0%2Fidentifier_select&openid.assoc_handle=usflex&openid.mode=checkid_setup&openid.claimed_id=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0%2Fidentifier_select&openid.ns=http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0"
); Fill in the login details and click the login button After navigating to the login page, this await page.waitForSelector("#ap_email") This ensures that it proceeds only when the element is visible and present in the DOM. #ap_email Once the email input field is present, the script uses the method to simulate typing the Amazon email address into the input field and then clicking the button using the method await ("#continue-announce") page.type continue page.click() page.click Now, the script uses this await page.waitForSelector("#ap_password") to wait for the element to appear; once the password input field is present, the script uses to simulate typing the Amazon password ap_password page.type Replace with your email and password. After entering the password, the script finds the element with the id and simulates a click. auth-signin-button After clicking on the sign-in button, the script uses this await page.waitForNavigation(); wait for the login to complete. await page.waitForSelector("#ap_password");
await page.type("#ap_password", ""); // Replace with your Amazon password
await page.click("#auth-signin-button");
// Wait for the login to complete
await page.waitForNavigation(); . Navigate to the product review page After logging in, the scripts navigate to the product page using this method "https://www.amazon.com/ENHANCE-Headphone-Customizable-Lighting-Flexible/dp/B07DR59JLP/",
{ timeout: 60000 }
); 3: Parse Review Data This allows you to extract data from the Amazon product review page by doing the following. Wait for reviews to load This uses ; to wait for the element with the name “ ” to be present. Until review elements are found. page.waitForSelector(".review") review 10 These elements represent individual product reviews on the Amazon product page. Extract information from review elements. After waiting for the information to load, this code block extracts information from the review elements. It retrieves the author's name, review text, and review date. const reviews = await page.$$eval(".review", (reviewElements) => {
return reviewElements.slice(0, 10).map((review) => {
const author = review.querySelector(".a-profile-name").textContent;
const text = review.querySelector(".a-row.review-data").textContent;
const date = review.querySelector(".review-date").textContent;
return { author, text, date };
});
}); 4: Export Reviews to CSV This allows you to save them in a format that is easy to analyze; in this tutorial, you will export them to CSV. Export the data to a CSV file. This is where Papaparse comes in because it exports data to CSV; the data it extracted from the review is passed to method, which converts the review data to CSV format. Papa.unparse() After creating the CSV file, this code writes the CSV data to using Node.js inbuilt file system (fs). amazon_reviews.csv const csvData = Papa.unparse(reviews);
fs.writeFileSync("amazon_reviews.csv", csvData); Output of CSV author,text,date
Whitney Brown,Verified Purchase,"Reviewed in the United States on July 7, 2021"
Eiskatze,Verified Purchase,"Reviewed in the United States on March 4, 2019"
Billy Johnson,Verified Purchase,"Reviewed in the United States on May 24, 2019"
Katelyn goering,Verified Purchase,"Reviewed in the United States on March 24, 2021"
Timothy A. Taylor,Verified Purchase,"Reviewed in the United States on March 19, 2022"
Sandra G.,Verified Purchase,"Reviewed in the United States on March 4, 2019"
Amazon Customer,Verified Purchase,"Reviewed in the United States on March 29, 2021"
Amra,Verified Purchase,"Reviewed in the United States on February 17, 2019"
pietro,Verified Purchase,"Reviewed in Italy on December 28, 2022"
OLIVIER DETRY,Verified Purchase,"Reviewed in France on December 26, 2020" Then use method to take screenshots of the review page and give it a name. For example, you can use . page.screenshot screenshot.png await page.screenshot({ path: "screenshot.png" }); Output of the screenshot The complete codebase You can check out the complete codebase on my Github Repo: https://github.com/wise4rmgod/Amazon-webscrapping Conclusion Web scraping a website that requires a login is easy with tools like Puppeteer, and it's useful for businesses that want to scrap customer reviews, especially from a site like Amazon. This tutorial covers scraping an Amazon product page behind a login using Puppeteer.

How to Scrape Amazon Product Reviews Behind a Login

As news break that in Chicago the taxicab industry is , because , Lyft and other ride-sharing companies outcompete them, I wonder if this has a net benefit to society. on the brink of collapse Uber Not just because the lives of real people and not investors are in danger due to the value of the taxi medallions in freefall (which cab drivers tend to own for retirement — and which often enough are paid by loans that cannot be adjusted for the drop in value, thus driving real people into bankruptcy). What many people have skipped so far in the entire taxicab debate (we have had it in Germany, too, but Uber and cannot offer ridesharing any more) is that taxicabs offer tangible benefits over Uber, Lyft and friends — which means, when taxicabs vanish, a lot of problems arise: lost in court 2016 People who do not own smartphones (esp. young kids, the elderly) or no credit cards, for whatever reason, lose the only form of individual point-to-point transport other than a car (which may be not another option due to lack of a license or being drunk) as there’s no way to hail a ride-share without a smartphone or a credit card to pay. People with disabilities (e.g. wheelchair-dependent people) lose a form of transport which is usually guaranteed by law (anti-discrimination rules). Uber and Lyft drivers tend to be driving in small, uncomfortable limos which cannot accomodate special needs, in contrast to cabs — in Germany, I can explicitly order a van cab if I need one. With a licensed taxi cab, the guest can usually be sure that the taxi driver knows his/her way through the city. With ride-share the situation can be a hit and miss, although the rating system seems to prevent “detour” scams pretty much. With a licensed taxi cab, the guest can usually rely on the taxi being both properly insured (as authorities won’t hand out medallions/taxi plates without proof of proper insurance) and in proper fitness to be on the road. Ride-shares, again, not so much. and especially not the “old school” forms of ride sharing… it’s not really funny if the driver comes up with a rusting-away VW Polo. Taxi cabs have a yearly check-up in Germany (in contrast to general automobiles, which have a mandatory check-up every two years). There don’t seem to be any restrictions on “road time” for ride-sharing services. It’s dangerous to drive too long, and even more dangerous to do so without breaks — I speak with personal experience. Employed taxi cab drivers, however, are subjected to labor laws limiting workdays to 8 hours. Uber and Lyft, for now, offer unsustainable fares, subsidized by massive amounts of venture capital. Once the taxi cabs have vanished and VC dries up, ride-share companies can jack up fares without any limit — in contrast to licensed taxi cabs, where the government sets mandatory tariffs. And as could be seen in the legal fights, especially Uber does not give a f..k about local laws and regulations anyway, so cities are looking at multiple-year-long lawsuits when they try to rein in the big ones. Public transport (buses, trains) is no full featured alternative to taxi cabs, in my opinion: in rural areas, buses often enough run twice a day and that’s it. The public transport usually entail a large amount of walking, which can be either physically impossible (for elderly people) or dangerous (kids). A taxi cab, however, can be hailed from anywhere to anywhere, and regulators in Germany tend to manage taxi cab licenses in a way that ensures that even at nighttime in a run-down part of a city (or in the midst of nowhere in the country) there will be a cab at your location in a reasonable time frame. networks Uber and Lyft, as well as the rest of the “gig economy” scam, are only successful because they evade laws and squeeze profits without end out of their “employees” or society as a whole. Drivers for Uber, for example, often . Airbnb, the second-in-command when it comes to ignoring or breaking laws, makes its profits on the back of society: Valuable living space is abused for short-term rentals, which jacks up rents and outprices “ordinary” people (in Berlin, for example, there are estimated ), and noisy tourists are a bane to neighbors. earn below minimum wage 13k apartments on Airbnb In my opinion, the answer to the problems which Uber, Lyft and other “gig economy” companies claim to solve (e.g. “high costs” or unflexible payment solutions — everyone can tell stories of not working CC readers in taxi cabs, for example) should better be solved through more and especially more efficient regulation, but not by letting VC-backed companies destroy parts of our society for private gain. is how hackers start their afternoons. We’re a part of the family. We are now and happy to opportunities. Hacker Noon @AMI accepting submissions discuss advertising & sponsorship To learn more, , , or simply, read our about page like/message us on Facebook tweet/DM @HackerNoon. If you enjoyed this story, we recommend reading our and . Until next time, don’t take the realities of the world for granted! latest tech stories trending tech stories

Stories, News & Mentions about UPFLEX

Upflex’s Stories on HackerNoon