Difference quotient

From Wikipedia, the free encyclopedia

The primary vehicle of calculus and other higher mathematics is the function. Its "input value" is its argument, usually a point ("P") expressible on a graph. The difference between two points, themselves, is known as their Delta (ΔP), as is the difference in their function result, the particular notation being determined by the direction of formation:

  • Forward difference:  ΔF(P) = F(P + ΔP) - F(P);
  • Central difference:  δF(P) = F(P + .5ΔP)- F(P - .5ΔP);
  • Backward difference: ∇F(P) = F(P) - F(P - ΔP).

The general preference is the forward orientation, as F(P) is the base, to which differences (i.e., "ΔP"s) are added to it. Furthermore,

  • If |ΔP| is finite (meaning measurable), then ΔF(P) is known as a finite difference, with specific denotations of DP and DF(P);
  • If |ΔP| is infinitesimal (an infinitely small amount—iota—usually expressed in standard analysis as a limit: \lim_{\Delta P\rightarrow 0}\,\!), then ΔF(P) is known as an infinitesimal difference, with specific denotations of dP and dF(P) (in calculus graphing, the point is almost exclusively identified as "x" and F(x) as "y").

The function difference divided by the point difference is known as the difference quotient (attributed to Isaac Newton, it is also known as Newton's quotient):

\frac{\Delta F(P)}{\Delta P}=\frac{F(P+\Delta P)-F(P)}{\Delta P}=\frac{\nabla F(P+\Delta P)}{\Delta P}.\,\!

If ΔP is infinitesimal, then the difference quotient is a derivative (which, when the object of integration, is known as an integrand), otherwise it is a divided difference:

\mbox{If } |\Delta P| = \mathit{ iota}: \quad \frac{\Delta F(P)}{\Delta P}=\frac{dF(P)}{dP}=F'(P)=G(P);\,\!
\mbox{If } |\Delta P| > \mathit{ iota}: \quad \frac{\Delta F(P)}{\Delta P}=\frac{DF(P)}{DP}=F[P,P+\Delta P].\,\!

Contents

[edit] Defining the point range

Regardless if ΔP is infinitesimal or finite, there is (at least—in the case of the derivative—theoretically) a point range, where the boundaries are P ± (.5)ΔP (depending on the orientation—ΔF(P), δF(P) or ∇F(P)):

LB = Lower Boundary;   UB = Upper Boundary;

Anyone familiar with derivatives knows that they can be regarded as functions themselves, harboring their own derivatives. Thus each function is home to sequential degrees ("higher orders") of derivation, or differentiation. This property can be generalized to all difference quotients.
As this sequencing requires a corresponding boundary splintering, it is practical to break up the point range into smaller, equi-sized sections, with each section being marked by an intermediary point ("Pi"), where LB = P0 and UB = Pń, the nth point, equaling the degree/order:

  LB =  P0  = P0 + 0Δ1P     = Pń - (Ń-0)Δ1P;
        P1  = P0 + 1Δ1P     = Pń - (Ń-1)Δ1P;
        P2  = P0 + 2Δ1P     = Pń - (Ń-2)Δ1P;
        P3  = P0 + 3Δ1P     = Pń - (Ń-3)Δ1P;
            ↓      ↓        ↓       ↓
       Pń-3 = P0 + (Ń-3)Δ1P = Pń - 3Δ1P;
       Pń-2 = P0 + (Ń-2)Δ1P = Pń - 2Δ1P;
       Pń-1 = P0 + (Ń-1)Δ1P = Pń - 1Δ1P;
  UB = Pń-0 = P0 + (Ń-0)Δ1P = Pń - 0Δ1P = Pń;
  ΔP = Δ1P = P1 - P0 = P2 - P1 = P3 - P2 = ... = Pń - Pń-1;
  ΔB = UB - LB = Pń - P0 = ΔńP = ŃΔ1P.

[edit] The primary difference quotient (Ń = 1)

\frac{\Delta F(P_0)}{\Delta P}=\frac{F(P_{\acute{n}})-F(P_0)}{\Delta_{\acute{n}}P}=\frac{F(P_1)-F(P_0)}{\Delta _1P}=\frac{F(P_1)-F(P_0)}{P_1-P_0}.\,\!

[edit] As a derivative

The difference quotient as a derivative needs no explanation, other than to point out that, since P0 essentially equals P1 = P2... = Pń (as the differences are infinitesimal), the Leibniz notation and derivative expressions do not distinguish P to P0 or Pń:
\frac{dF(P)}{dP}=\frac{F(P_1)-F(P_0)}{dP}=F'(P)=G(P).\,\!

There are other derivative notations, but these are the most recognized, standard designations.

[edit] As a divided difference

A divided difference, however, does require further elucidation, as it equals the average derivative between and including LB and UB:
P_{(tn)}=LB+\frac{TN-1}{UT-1}\Delta B \ =UB-\frac{UT-TN}{UT-1}\Delta B;\,\!
\overline{(P_{(1)}=LB \mbox{, }P_{(ut)}=UB)}\,\!
F'(P_\tilde{a})=F'(LB\!<\!P\!<\!UB)=\sum_{TN=1}^{UT=\infty}\frac{F'(P_{(tn)})}{UT}.\,\!
In this interpretation, Pã represents a function extracted, average value of P (midrange, but usually not exactly midpoint), the particular valuation depending on the function averaging it is extracted from. More formally, Pã is found in the mean value theorem of calculus, which says:
For any function that is continuous on [LB,UB] and differentiable on (LB,UB) there exists some Pã in the interval (LB,UB) such that the secant joining the endpoints of the interval [LB,UB] is parallel to the tangent at Pã.
Essentially, Pã denotes some value of P between LB and UB—hence,
P_\tilde{a}:=LB\!<\!P\!<\!UB=P_0\!<\!P\!<\!P_\acute{n}\,\!
which links the mean value result with the divided difference:
\frac{DF(P_0)}{DP} =F[P_0,P_1]=\frac{F(P_1)-F(P_0)}{P_1-P_0}=F'(P_0\!<\!P\!<\!P_1)=\sum_{TN=1}^{UT=\infty}\frac{F'(P_{(tn)})}{UT},\,\!
=\frac{DF(LB)}{DB}=\frac{\Delta F(LB)}{\Delta B}=\frac{\nabla F(UB)}{\Delta B},\,\!
=F[LB,UB]=\frac{F(UB)-F(LB)}{UB-LB},\,\!
=F'(LB\!<\!P\!<\!UB)=G(LB\!<\!P\!<\!UB).\,\!
As there is, by its very definition, a tangible difference between LB/P0 and UB/Pń, the Leibniz and derivative expressions do require divarication of the function argument.

[edit] Higher order difference quotients

[edit] Second order

\frac{\Delta^2F(P_0)}{\Delta_1P^2}\,\! =\frac{\Delta F'(P_0)}{\Delta_1P}=\frac{\frac{\Delta F(P_1)}{\Delta_1P}-\frac{\Delta F(P_0)}{\Delta_1P}}{\Delta_1P},\,\!
=\frac{\frac{F(P_2)-F(P_1)}{\Delta_1P}-\frac{F(P_1)-F(P_0)}{\Delta_1P}}{\Delta_1P},\,\!
=\frac{F(P_2)-2F(P_1)+F(P_0)}{\Delta_1P^2};\,\!
\frac{d^2F(P)}{dP^2}\,\! =\frac{dF'(P)}{dP}=\frac{F'(P_1)-F'(P_0)}{dP},\,\!
=\ \frac{dG(P)}{dP}=\frac{G(P_1)-G(P_0)}{dP},\,\!
=\frac{F(P_2)-2F(P_1)+F(P_0)}{dP^2},\,\!
=F''(P)=G'(P)=H(P);\,\!
\frac{D^2F(P_0)}{DP^2}\,\! =\frac{DF'(P_0)}{DP}=\frac{F'(P_1\!<\!P\!<\!P_2)-F'(P_0\!<\!P\!<\!P_1)}{P_1-P_0},\,\!
\cdot\qquad\qquad\ \ \ne\frac{F'(P_1)-F'(P_0)}{P_1-P_0},\,\!
=F[P_0,P_1,P_2]=\frac{F(P_2)-2F(P_1)+F(P_0)}{(P_1-P_0)^2},\,\!
=F''(P_0\!<\!P\!<\!P_2)=\sum_{TN=1}^{UT=\infty}\frac{F''(P_{(tn)})}{UT},\,\!
=G'(P_0\!<\!P\!<\!P_2)=H(P_0\!<\!P\!<\!P_2).\,\!

[edit] Third order

\frac{\Delta^3F(P_0)}{\Delta_1P^3}\,\! =\frac{\Delta^2 F'(P_0)}{\Delta_1P^2}=\frac{\Delta F''(P_0)}{\Delta_1P} =\frac{\frac{\Delta F'(P_1)}{\Delta_1P}-\frac{\Delta F'(P_0)}{\Delta_1P}}{\Delta_1P},\,\!
=\frac{\frac{\frac{\Delta F(P_2)}{\Delta_1P}-\frac{\Delta F'(P_1)}{\Delta_1P}}{\Delta_1P}- \frac{\frac{\Delta F'(P_1)}{\Delta_1P}-\frac{\Delta F'(P_0)}{\Delta_1P}}{\Delta_1P}}{\Delta_1P},\,\!
=\frac{\frac{F(P_3)-2F(P_2)+F(P_1)}{\Delta_1P^2}-\frac{F(P_2)-2F(P_1)+F(P_0)}{\Delta_1P^2}}{\Delta_1P},\,\!
=\frac{F(P_3)-3F(P_2)+3F(P_1)-F(P_0)}{\Delta_1P^3};\,\!
\frac{d^3F(P)}{dP^3}\,\! =\frac{d^2F'(P)}{dP^2}=\frac{dF''(P)}{dP}=\frac{F''(P_1)-F''(P_0)}{dP},\,\!
=\frac{d^2G(P)}{dP^2}\ =\frac{dG'(P)}{dP}\ =\frac{G'(P_1)-G'(P_0)}{dP},\,\!
\cdot\qquad\qquad\ \ =\frac{dH(P)}{dP}\ =\frac{H(P_1)-H(P_0)}{dP},\,\!
=\frac{G(P_2)-2G(P_1)+G(P_0)}{dP^2},\,\!
=\frac{F(P_3)-3F(P_2)+3F(P_1)-F(P_0)}{dP^3},\,\!
=F'''(P)=G''(P)=H'(P)=I(P);\,\!
\frac{D^3F(P_0)}{DP^3}\,\! =\frac{D^2F'(P_0)}{DP^2}=\frac{DF''(P_0)}{DP}=\frac{F''(P_1\!<\!P\!<\!P_3)-F''(P_0\!<\!P\!<\!P_2)}{P_1-P_0},\,\!
\cdot\qquad\qquad\qquad\qquad\qquad\ \ \ne\frac{F''(P_1)-F''(P_0)}{P_1-P_0},\,\!
=\frac{\frac{F'(P_2\!<\!P\!<\!P_3)-F'(P_1\!<\!P\!<\!P_2)}{P_1-P_0}-\frac{F'(P_1\!<\!P\!<\!P_2)-F'(P_0\!<\!P\!<\!P_1)}{P_1-P_0}}{P_1-P_0},\,\!
=\frac{F'(P_2\!<\!P\!<\!P_3)-2F'(P_1\!<\!P\!<\!P_2)+F'(P_0\!<\!P\!<\!P_1)}{(P_1-P_0)^2},\,\!
=F[P_0,P_1,P_2,P_3]=\frac{F(P_3)-3F(P_2)+3F(P_1)-F(P_0)}{(P_1-P_0)^3},\,\!
=F'''(P_0\!<\!P\!<\!P_3)=\sum_{TN=1}^{UT=\infty}\frac{F'''(P_{(tn)})}{UT},\,\!
=G''(P_0\!<\!P\!<\!P_3)\ =H'(P_0\!<\!P\!<\!P_3)=I(P_0\!<\!P\!<\!P_3).\,\!

[edit] Ńth Order

\Delta^\acute{n}F(P_0)\,\! =F^{(\acute{n}-1)}(P_1)-F^{(\acute{n}-1)}(P_0),\,\!
=\frac{F^{(\acute{n}-2)}(P_2)-F^{(\acute{n}-2)}(P_1)}{\Delta_1P}-\frac{F^{(\acute{n}-2)}(P_1)-F^{(\acute{n}-2)}(P_0)}{\Delta_1P},\,\!
=\frac{\frac{F^{(\acute{n}-3)}(P_3)-F^{(\acute{n}-3)}(P_2)}{\Delta_1P}-\frac{F^{(\acute{n}-3)}(P_2)-F^{(\acute{n}-3)}(P_1)}{\Delta_1P}}{\Delta_1P}\,\!
\cdot\qquad -\frac{\frac{F^{(\acute{n}-3)}(P_2)-F^{(\acute{n}-3)}(P_1)}{\Delta_1P}-\frac{F^{(\acute{n}-3)}(P_1)-F^{(\acute{n}-3)}(P_0)}{\Delta_1P}}{\Delta_1P},\,\!
=\;\ldots\ ;\,\!
\frac{\Delta^\acute{n}F(P_0)}{\Delta_1P^\acute{n}}\,\! =\frac{\sum_{I=0}^{\acute{N}}{-1\choose\acute{N}-I}{\acute{N}\choose I}F(P_0+I\Delta_1P)}{\Delta_1P^\acute{n}};\,\!
\frac{\nabla^\acute{n}F(P_\acute{n})}{\Delta_1P^\acute{n}}\,\! =\frac{\sum_{I=0}^{\acute{N}}{-1\choose I}{\acute{N}\choose I}F(P_\acute{n}-I\Delta_1P)}{\Delta_1P^\acute{n}};\,\!
\frac{d^\acute{n}F(P_0)}{dP^\acute{n}}\,\! =\frac{d^{\acute{n}-1}F'(P_0)}{dP^{\acute{n}-1}} =\frac{d^{\acute{n}-2}F''(P_0)}{dP^{\acute{n}-2}} =\frac{d^{\acute{n}-3}F'''(P_0)}{dP^{\acute{n}-3}}\ldots=\frac{d^{\acute{n}-r}F^{(r)}(P_0)}{dP^{\acute{n}-r}}, \,\!
=\frac{d^{\acute{n}-1}G(P_0)}{dP^{\acute{n}-1}}\  =\frac{d^{\acute{n}-2}G'(P_0)}{dP^{\acute{n}-2}}=\ \frac{d^{\acute{n}-3}G''(P_0)}{dP^{\acute{n}-3}}\ldots=\frac{d^{\acute{n}-r}G^{(r-1)}(P_0)}{dP^{\acute{n}-r}},\,\!
\cdot\qquad\qquad\qquad=\frac{d^{\acute{n}-2}H(P_0)}{dP^{\acute{n}-2}} =\ \frac{d^{\acute{n}-3}H'(P_0)}{dP^{\acute{n}-3}}\ldots=\frac{d^{\acute{n}-r}H^{(r-2)}(P_0)}{dP^{\acute{n}-r}},\,\!
\cdot\qquad\qquad\qquad\qquad\qquad\qquad\ =\ \frac{d^{\acute{n}-3}I(P_0)}{dP^{\acute{n}-3}} \;\;\ldots=\frac{d^{\acute{n}-r}I^{(r-3)}(P_0)}{dP^{\acute{n}-r}},\,\!
=F^{(\acute{n})}(P)=G^{(\acute{n}-1)}(P)=H^{(\acute{n}-2)}(P)=I^{(\acute{n}-3)}(P)=\ldots\ ;\,\!
\frac{D^\acute{n}F(P_0)}{DP^\acute{n}}\,\! =F[P_0,P_1,P_2,P_3,\ldots,P_{\acute{n}-3},P_{\acute{n}-2},P_{\acute{n}-1},P_\acute{n}],\,\!
=F^{(\acute{n})}(P_0\!<\!P\!<\!P_\acute{n})=\sum_{TN=1}^{UT=\infty}\frac{F^{(\acute{n})}(P_{(tn)})}{UT} ,\,\!
=F^{(\acute{n})}(LB\!<\!P\!<\!UB)=G^{(\acute{n}-1)}(LB\!<\!P\!<\!UB)=...\ .\,\!

[edit] Applying the divided difference

The quintessential application of the divided difference is in the presentation of the definite integral, which is nothing more than a finite difference:

\int_{LB}^{UB} G(p)dp\,\! =\int_{LB}^{UB} F'(p)dp=F(UB)-F(LB),\,\!
=F[LB,UB]\Delta B,\,\!
=F'(LB\!<\!P\!<\!UB)\Delta B,\,\!
=\ G(LB\!<\!P\!<\!UB)\Delta B.\,\!

Given that the mean value, derivative expression form provides all of the same information as the classical integral notation, the mean value form may be the preferable expression, such as in writing venues that only support/accept standard ASCII text, or in cases that only require the average derivative (such as when finding the average radius in an elliptic integral). This is especially true for definite integrals that technically have (e.g.) 0 and either \pi\,\! or 2\pi\,\! as boundaries, with the same divided difference found as that with boundaries of 0 and \begin{matrix}\frac{\pi}{2}\end{matrix} (thus requiring less averaging effort):

\int_{0}^{2\pi} F'(p)dp\,\! =4\int_{0}^{\frac{\pi}{2}} F'(p)dp=F(2\pi)-F(0)=4(F(\begin{matrix}\frac{\pi}{2}\end{matrix})-F(0)),\,\!
=2\pi F[0,2\pi]=2\pi F'(0\!<\!P\!<\!2\pi),\,\!
=2\pi F[0,\begin{matrix}\frac{\pi}{2}\end{matrix}]\;\ =2\pi F'(0\!<\!P\!<\!\begin{matrix}\frac{\pi}{2}\end{matrix}).\,\!

This also becomes particularly useful when dealing with iterated and multiple integrals (ΔA = AU - AL, ΔB = BU - BL, ΔC = CU - CL):

\int_{CL}^{CU}\int_{BL}^{BU}\int_{AL}^{AU} F'(r,q,p)dp\,dq\,dr\,\!
=\sum_{T\!C=1}^{U\!C=\infty}\left(\sum_{T\!B=1}^{U\!B=\infty} \left(\sum_{T\!A=1}^{U\!A=\infty}F^'(R_{(tc)}:Q_{(tb)}:P_{(ta)})\frac{\Delta A}{U\!A}\right)\frac{\Delta B}{U\!B}\right)\frac{\Delta C}{U\!C},\,\!
= F'(C\!L\!<\!R\!<\!CU:BL\!<\!Q\!<\!BU:AL\!<\!P\!<\!AU) \Delta A\,\Delta B\,\Delta C .\,\!

Hence,

F'(R,Q:AL\!<\!P\!<\!AU)=\sum_{T\!A=1}^{U\!A=\infty} \frac{F'(R,Q:P_{(ta)})}{U\!A};\,\!

and

F'(R:BL\!<\!Q\!<\!BU:AL\!<\!P\!<\!AU)=\sum_{T\!B=1}^{U\!B=\infty}\left(\sum_{T\!A=1}^{U\!A=\infty}\frac{F'(R:Q_{(tb)}:P_{(ta)})}{U\!A}\right)\frac{1}{U\!B}.\,\!

[edit] See also

[edit] External links