EDUCBA

EDUCBA

MENUMENU
  • Free Tutorials
  • Free Courses
  • Certification Courses
  • 360+ Courses All in One Bundle
  • Login

What is Linear Regression?

By Priya PedamkarPriya Pedamkar

Secondary Sidebar
Machine Learning Tutorial
  • Basic
    • Introduction To Machine Learning
    • What is Machine Learning?
    • Uses of Machine Learning
    • Applications of Machine Learning
    • Naive Bayes in Machine Learning
    • Dataset Labelling
    • DataSet Example
    • Deep Learning Techniques
    • Dataset ZFS
    • Careers in Machine Learning
    • What is Machine Cycle?
    • Machine Learning Feature
    • Machine Learning Programming Languages
    • What is Kernel in Machine Learning
    • Machine Learning Tools
    • Machine Learning Models
    • Machine Learning Platform
    • Machine Learning Libraries
    • Machine Learning Life Cycle
    • Machine Learning System
    • Machine Learning Datasets
    • Machine Learning Certifications
    • Machine Learning Python vs R
    • Optimization for Machine Learning
    • Types of Machine Learning
    • Machine Learning Methods
    • Machine Learning Software
    • Machine Learning Techniques
    • Machine Learning Feature Selection
    • Ensemble Methods in Machine Learning
    • Support Vector Machine in Machine Learning
    • Decision Making Techniques
    • Restricted Boltzmann Machine
    • Regularization Machine Learning
    • What is Regression?
    • What is Linear Regression?
    • Dataset for Linear Regression
    • Decision tree limitations
    • What is Decision Tree?
    • What is Random Forest
  • Algorithms
    • Machine Learning Algorithms
    • Apriori Algorithm in Machine Learning
    • Types of Machine Learning Algorithms
    • Bayes Theorem
    • AdaBoost Algorithm
    • Classification Algorithms
    • Clustering Algorithm
    • Gradient Boosting Algorithm
    • Mean Shift Algorithm
    • Hierarchical Clustering Algorithm
    • Hierarchical Clustering Agglomerative
    • What is a Greedy Algorithm?
    • What is Genetic Algorithm?
    • Random Forest Algorithm
    • Nearest Neighbors Algorithm
    • Weak Law of Large Numbers
    • Ray Tracing Algorithm
    • SVM Algorithm
    • Naive Bayes Algorithm
    • Neural Network Algorithms
    • Boosting Algorithm
    • XGBoost Algorithm
    • Pattern Searching
    • Loss Functions in Machine Learning
    • Decision Tree in Machine Learning
    • Hyperparameter Machine Learning
    • Unsupervised Machine Learning
    • K- Means Clustering Algorithm
    • KNN Algorithm
    • Monty Hall Problem
  • Supervised
    • What is Supervised Learning
    • Supervised Machine Learning
    • Supervised Machine Learning Algorithms
    • Perceptron Learning Algorithm
    • Simple Linear Regression
    • Polynomial Regression
    • Multivariate Regression
    • Regression in Machine Learning
    • Hierarchical Clustering Analysis
    • Linear Regression Analysis
    • Support Vector Regression
    • Multiple Linear Regression
    • Linear Algebra in Machine Learning
    • Statistics for Machine Learning
    • What is Regression Analysis?
    • Clustering Methods
    • Backward Elimination
    • Ensemble Techniques
    • Bagging and Boosting
    • Linear Regression Modeling
    • What is Reinforcement Learning
  • Classification
    • Kernel Methods in Machine Learning
    • Clustering in Machine Learning
    • Machine Learning Architecture
    • Automation Anywhere Architecture
    • Machine Learning C++ Library
    • Machine Learning Frameworks
    • Data Preprocessing in Machine Learning
    • Data Science Machine Learning
    • Classification of Neural Network
    • Neural Network Machine Learning
    • What is Convolutional Neural Network?
    • Single Layer Neural Network
    • Kernel Methods
    • Forward and Backward Chaining
    • Forward Chaining
    • Backward Chaining
  • Deep Learning
    • What Is Deep learning
    • Overviews Deep Learning
    • Application of Deep Learning
    • Careers in Deep Learnings
    • Deep Learning Frameworks
    • Deep Learning Model
    • Deep Learning Algorithms
    • Deep Learning Technique
    • Deep Learning Networks
    • Deep Learning Libraries
    • Deep Learning Toolbox
    • Types of Neural Networks
    • Convolutional Neural Networks
    • Create Decision Tree
    • Deep Learning for NLP
    • Caffe Deep Learning
    • Deep Learning with TensorFlow
  • RPA
    • What is RPA
    • What is Robotics?
    • Benefits of RPA
    • RPA Applications
    • Types of Robots
    • RPA Tools
    • Line Follower Robot
    • What is Blue Prism?
    • RPA vs BPM
  • Interview Questions
    • Deep Learning Interview Questions And Answer
    • Machine Learning Cheat Sheet

Related Courses

Machine Learning Training

Deep Learning Training

Artificial Intelligence Training

Home Data Science Data Science Tutorials Machine Learning Tutorial What is Linear Regression?

What is Linear Regression?

What is Linear Regression?

Linear regression is one of the ways to perform predictive analysis. It is used to examine regression estimates.

All in One Data Science Bundle(360+ Courses, 50+ projects)
Python TutorialMachine LearningAWSArtificial Intelligence
TableauR ProgrammingPowerBIDeep Learning
Price
View Courses
360+ Online Courses | 50+ projects | 1500+ Hours | Verifiable Certificates | Lifetime Access
4.7 (85,938 ratings)
  • To predict the outcome from the set of predictor variables
  • Which predictor variables have maximum influence on the outcome variable?

The regression estimates explain the relationship between one dependent variable and one or more independent variables. The same is represented in the below equation.

Start Your Free Data Science Course

Hadoop, Data Science, Statistics & others

The formula for linear Regression:

y = mx + c
  • x: Score of the independent variable
  • m: Regression coefficient
  • c: Constant
  • x: Independent variable

The variable names may differ. The regression dependent variable can be called as outcome variable or criterion variable or an endogenous variable. The independent variable can also be called an exogenous variable.

Why we Use Linear Regression?

Linear regression is used to perform regression analysis. Below are the uses of regression analysis.

  • Help determine the strength of Predictors: This technique is used in sales and marketing.  Predictive analysis helps in understanding the relationship between the predictor and outcome variable (i.e. dose and effect).
  • Forecast the effect through Prediction: The change in the dependent variable will cause a difference in an independent variable.  For example, if you spend more money on marketing a product it can affect the sales to increase or decrease.
  • Trend Analysis / Forecasting: Regression analysis is used to predict future trends especially in the share market where there are fluctuations and inflation in prices.

Types of Linear Regression

Below are the 5 types of Linear regression:

1. Simple Linear Regression

Simple regression has one dependent variable (interval or ratio), one independent variable (interval or ratio or dichotomous). The example can be measuring a child’s height every year of growth. The usual growth is 3 inches. Many such real-world examples can be categorized under simple linear regression.

2. Multiple Linear Regression

Multiple regression is used when we have two independent variables and one dependent variable. We can determine what effect the independent variables have on a dependent variable.

In Multiple regression, we can suppose x to be a series of independent variables (x1, x2 …) and Y to be a dependent variable. We also have b as the slope of a regression variable. Below is the equation that represents the relation between x and y.

Y = a + b1x1 + b2x2 + …

The example that can be categorized under multiple regression is calculating blood pressure where the independent variables can be height, weight, amount of exercise. The selection of variables is also important while performing multiple regression analysis. We should understand are important variables and unimportant variables before we create a model.

3. Logistic Regression

Logistic regression is done when there are one dependent variable and two independent variables. The difference between multiple and logistic regression is that the target variable is discrete (binary or an ordinal value). The problem with linear regression is the variable value is fixed only to two possible outcomes. Logistic regression, on the other hand, can return a probability score that reflects on the occurrence of a particular event.

Logistic regression is used in several different cases like detecting spam emails, predicting a customer loan amount, whether a person will buy a particular product or not. Logistic regression is good at determining the probability of an event occurrence. Logistic regression is used in several machine learning algorithms.

4. Ordinal Regression

Ordinal regression is performed on one dependent dichotomous variable and one independent variable which can be ordinal or nominal. Ordinal regression can be performed using the Generalised linear model (GLM).In machine learning terms, it is also called a ranking analysis.

In marketing, Ordinal regression is used to predict whether a purchase of the product can lead a consumer can buy a related product. For example, if a consumer buys a pizza, how is he /she likely to order a soft drink along with it. Further considering the quantity of a soft drink. Various factors affect the order of a soft drink like the size of the pizza ordered and complimentary food items given along with the order. Remember, there is also a difference between the prices of soft drinks along with the quantity.

5. Multinomial Regression

Multinomial regression is done on one nominal dependent variable and one independent variable which is the ratio, interval, or dichotomous.

An example of Multinomial regression can be occupational preferences among the students that dependent on the parent’s occupation and education.

Importance of Regression Analysis

Below are the importance mentioned:

  • Regression analysis helps in understanding the various data points and the relationship between them. It is considered to be significant in business models.
  • Regression analysis is also used for forecasting and prediction.
  • Understanding the data and relationship between them helps businesses to grow and analyze certain trends or patterns. It can provide new insights to businesses and is valuable.
  • While plotting the data points, Regression analysis helps to understand the failures of a company and correct them to succeed by avoiding mistakes. This kind of analysis will help when a new product is launched into the market and determine the success of that product.
  • Regression analysis also helps the company provide maximum efficiency and refine its processes.

Recommended Articles

This is a guide to What is Linear Regression?. Here we discuss how to use linear regression, the top 5 types, and importance in detail understanding. You can also go through our other related articles to learn more –

  1. Multiple Linear Regression in R
  2. Simple Linear Regression in R
  3. Linear Regression Analysis
  4. Linear Regression Modeling
Popular Course in this category
Machine Learning Training (20 Courses, 29+ Projects)
  19 Online Courses |  29 Hands-on Projects |  178+ Hours |  Verifiable Certificate of Completion
4.7
Price

View Course

Related Courses

Deep Learning Training (18 Courses, 24+ Projects)4.9
Artificial Intelligence AI Training (5 Courses, 2 Project)4.8
0 Shares
Share
Tweet
Share
Primary Sidebar
Footer
About Us
  • Blog
  • Who is EDUCBA?
  • Sign Up
  • Live Classes
  • Corporate Training
  • Certificate from Top Institutions
  • Contact Us
  • Verifiable Certificate
  • Reviews
  • Terms and Conditions
  • Privacy Policy
  •  
Apps
  • iPhone & iPad
  • Android
Resources
  • Free Courses
  • Database Management
  • Machine Learning
  • All Tutorials
Certification Courses
  • All Courses
  • Data Science Course - All in One Bundle
  • Machine Learning Course
  • Hadoop Certification Training
  • Cloud Computing Training Course
  • R Programming Course
  • AWS Training Course
  • SAS Training Course

ISO 10004:2018 & ISO 9001:2015 Certified

© 2022 - EDUCBA. ALL RIGHTS RESERVED. THE CERTIFICATION NAMES ARE THE TRADEMARKS OF THEIR RESPECTIVE OWNERS.

EDUCBA
Free Data Science Course

SPSS, Data visualization with Python, Matplotlib Library, Seaborn Package

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA Login

Forgot Password?

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA
Free Data Science Course

Hadoop, Data Science, Statistics & others

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

Let’s Get Started

By signing up, you agree to our Terms of Use and Privacy Policy.

This website or its third-party tools use cookies, which are necessary to its functioning and required to achieve the purposes illustrated in the cookie policy. By closing this banner, scrolling this page, clicking a link or continuing to browse otherwise, you agree to our Privacy Policy

Loading . . .
Quiz
Question:

Answer:

Quiz Result
Total QuestionsCorrect AnswersWrong AnswersPercentage

Explore 1000+ varieties of Mock tests View more

Special Offer - Machine Learning Training (20 Courses, 29+ Projects) Learn More