Today I'm going to share you some easy but cool stuffs which I tried on my Linux Terminal. Today I downloaded this blog techjhola.com to my local machine with the help of command line tool "Wget".
Wget is a free utility for non-interactive download of files from the Web. It supports HTTP, HTTPS, and FTP protocols, as well as retrieval through HTTP proxies. Wget is non-interactive, meaning that it can work in the background, while the user is not logged on. This allows you to start a retrieval and disconnect from the system, letting Wget finish the work. By contrast, most of the Web browsers require constant user's presence, which can be a great hindrance when transferring a lot of data.
Today I will show you how I did the web scrapping of my website. Web Scrapping simply means downloading data from any online platform through automation of third party software. I've added a screenshot of the downloading activity created by wget. The command below looks kind of lengthy. The command I used is:
sudo wget --show-progress --progress=dot --verbose --recurseve --retryconnrefused -x --level=5 https://www.techjhola.com
I'll now break the command and describe the use of each parameters used within a single command.
Basically to download a website it is okey to provide the default command wget www.sitename.com. But at the same time you should make sure if the download is on progress so you add the parameter: --show-progress. So i used --show-progress command along with the dot displaying parameter --progress=dot.
Now that a website will have different directories that it fetched tie file from so I added a --recursive parameter. -x is used such that I shouldn't bother about any restrictions and I can download the site forcefully.
--retry-connrefused This is useful parameter which helps to continuously retry connecting to the website and establish a connection.
Wget has this special parameter level, which you shouldn't miss using wihle downloading a website which has many indepth urls within an article or a page.
Suppose you use --level=3, than the download begins with the doamin i.e. www.techjhola.com ans it starts downloading all data of the domain. If it finds any content with a weblink then it downloads everything inside that weblink. Same is done till it reaches its final level i.e. 3.
There are huge bunch of parameters that you can implement while executing the command. To learn about the tool type man wget in your terminal.
Offline Wikiepdia in HeNN E-Library Project
There are more than 35 E-Libraries setup in Nepal by Help Nepal Network which runs on Linux Machine(Edubuntu : Educational Distribution of Ubuntu). What we the volunteers from Kathmandu University Open Source Community have done is, we have download GBs of wikipedia from the High Bandwidth University Internet and added those contents to the E-Libraries. And the volunteers update the content of wikipedia every three months they visit the site for Monitoring.
Today's blog is about a simple issue you sometimes encounter after you rename your machine's hostname.
[email protected]:~$ sudo cat /etc/hostnameUnable to resolve hostname xenialPlease enter your password:
This issue occurred to me just recently when I renamed my machine name from whoareyou to xenail.
Everytime I encountered this "Unable to resolve hostname xenial" issue
Earlier while I checked my hostname with command sudo cat /etc/hostname the result was xenial.
[email protected]:~$ sudo cat /etc/hostnamexenial
But the hostname was not listed inside /etc/hosts. I checked with command sudo cat /etc/hosts
[email protected]:~$ sudo cat /etc/hosts
The exact reason for why the host xenail wasn't listed in hosts is yet unknown. But in order to resolve the issue I did this simple tweak.
I renamed the hostname xenial from /etc/hostname to whoareyou. and restarted the machine. Then after the issue was no more encountered. As simple as it is.
Internet Explorer, Firefox and Google chrome each allow for the use of plug-ins and add-ons which are scripts that augment the functionality of the browser. In this we are going to see how to disable or remove such plug-in or add-ons from these three main browsers.
- In the menu bar select Tools > Add- ons.
- Then click on plug- ins icon on your left side.
- Find the plug-in from the list of installed plug-ins that you want to remove
- Select it and click on the Disable button (or click on always activate and select Never Activate) on the right side.
NOTE: In Google Chrome, Add-ons are called Extensions.
- At the top of the browser, click on the “menu” icon and navigate to Tools > Extensions
- In the Extensions tab, find the list of installed extensions that you want to remove.
- Click the Disable link or uninstall link under the name of the extension.
- In the menu bar, select Tools > Manage add or click on the “gear” icon and select Mange add-ons.
- In the manage Add-ons window, we can find the add on from list of currently loaded add-ons on the right.
- Select it and click on the Disable bottom.
HOW TO STOP RECEIVING GAME REQUESTS ON FACEBOOK
HOW TO DISABLE VIDEOS AUTO-PLAY ON FACEBOOK
CONTROL HOW MUCH DATA FACEBOOK DOWNLOADS ON YOUR PHONE
TIP 1: HOW TO DISABLE VIBRATION DURING CALLS ON ANDROID
TIP 2: HOW TO TAKE A SCREENSHOT ON ANDROID
TIP 3: HOW TO SET THE DEFAULT DIALER IN ANDROID
TIP 4: HOW TO OPTIMIZE PHONE SCREEN IN CYANOGENMOD
TIP 5: HOW TO VIEW SAVED WIFI PASSWORD ON ANDROID DEVICES