Suppose we assume the usual linear relationship yibo byai e for n pairs of obser

Question

Suppose we assume the usual linear relationship yibo byai e for n pairs of observations (xi, yi), (x2,32),. ,(En, yn). Now, show what we would calculate for the coefficients bo and bi under the following criteria. a. (8 pts) Suppose we insist that the average error is zero: e-0. What condition must b0 satisfy in order for that relationship to hold? b. (12 pts) Now further suppose that we insist upon the correlation between the inputs and the errors being zero: relationship to hold? a, what condition must b satisfy in order for that rze 0. Using the bo you found in part

Explanation / Answer

To establish the linear regression model,

Yi = b0 + b1 Xi + ei

We will apply the technique of Method Of Least Squares (MLS) to estimate the parameters b0 and b1.

This method consists of minimizing Error sum of squares given by

E = ei2 = (Yi - b0 - b1 Xi)2

On differentiating with respect to the parameters b0 and b1 we get two normal equations and solving them we can see that estimates of parameters b0 and b1 are as follows:

b1 = Cov(X,Y)/Var(X) and b0 = Ybar – b1 Xbar.

Thus for the sake of calculations we should prepare the following table:

i

Xi

Yi

Xi2

Yi2

Xi* Yi

1

2

.

.

n

Total

X

Y

X2

Y2

XY

After getting these totals in table it is easy to estimate both the parameters.

In order to hold this relation the condition b0 is it should be NON ZERO.

Condition on b1 is also same that it must be NON ZERO.

Here we must note that the relation is linear so that graphically it represents a straight line, where b0 is interpreted as intercept on Y axis or it is the value of Y in the absence of X. Similarly b1 is interpreted as slope of the line, which is rate of change in Y per unit change in X.   

i

Xi

Yi

Xi2

Yi2

Xi* Yi

1

2

.

.

n

Total

X

Y

X2

Y2

XY

Related Questions

Navigate

• Browse (All)
• Browse S
• Subjects

---