WebMaven TechSpecs: Difference between revisions

From OS2World.Com Wiki
Jump to navigation Jump to search
Created page with "==Definition of terms:== In order to fully understand the material below, it is necessary to specify some of the jargon used with WebMaven. <center> {| width="100%" cellpad..."
 
No edit summary
 
(2 intermediate revisions by one other user not shown)
Line 1: Line 1:
==Definition of terms:==
;Definition of terms:In order to fully understand the material below, it is necessary to specify some of the jargon used with WebMaven.


In order to fully understand the material below, it is necessary to specify some of the jargon used with WebMaven. <center>
{|class="wikitable"
 
|-
{| width="100%" cellpadding="5" align="center"
!Term
|- valign="top"
!Definition
! '''<u>Term</u>'''
! '''<u>Definition</u>'''
|-
|-
| colspan="2" |
!URI
----
|WebMaven uses the term URI to encompass URLs along with other associated data necessary to reference a file via the HTTP protocol. From RFC 2068:
|- valign="top"
| nowrap="nowrap" | '''URI'''
| <font size="-1"> WebMaven uses the term URI to encompass URLs along with other associated data necessary to reference a file via the HTTP protocol. From RFC 2068:


<blockquote> URIs have been known by many names: WWW addresses, Universal Document Identifiers, Universal Resource Identifiers , and finally the combination of Uniform Resource Locators (URL) and Names (URN). As far as HTTP is concerned, Uniform Resource Identifiers are simply formatted strings which identify -- via name, location, or any other characteristic -- a resource.</blockquote></font>
URIs have been known by many names: WWW addresses, Universal Document Identifiers, Universal Resource Identifiers , and finally the combination of Uniform Resource Locators (URL) and Names (URN). As far as HTTP is concerned, Uniform Resource Identifiers are simply formatted strings which identify -- via name, location, or any other characteristic -- a resource.
|-
|-
| colspan="2" |
!Local path
----
|A remote site, be it a complete domain (e.g. www.cfsrexx.com) or one or more paths within a remote domain (e.g. www.cfsrexx.com/pub/ & www.cfsrexx.com/WebMaven/) are downloaded into the local path directory.
|- valign="top"
| nowrap="nowrap" | '''Local path'''
| <font size="-1"> A remote site, be it a complete domain (e.g. www.cfsrexx.com) or one or more paths within a remote domain (e.g. www.cfsrexx.com/pub/ & www.cfsrexx.com/WebMaven/) are downloaded into the local path directory.


'''Note:''' [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#RemotePathsPerLocalTree Multiple remote paths] can only be specified with a the enterprise edition.
'''Note:''' [http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#RemotePathsPerLocalTree Multiple remote paths] can only be specified with a the enterprise edition.
 
</font>
|-
|-
| colspan="2" |
!Remote path
----
|Remote path is a domain name, with or without a path. The remote path corresponds to the local path on a one-to-one basis when only one remote path is specified.
|- valign="top"
| nowrap="nowrap" | '''Remote path'''
| <font size="-1"> Remote path is a domain name, with or without a path. The remote path corresponds to the local path on a one-to-one basis when only one remote path is specified.


When more than one remote path is specified, each directory in the remote path corresponds, one-for-one, with a local directory subordinate to the local path. Multiple remote paths can include the same or different domains and protocols.
When more than one remote path is specified, each directory in the remote path corresponds, one-for-one, with a local directory subordinate to the local path. Multiple remote paths can include the same or different domains and protocols.


For example, assuming the following remote tree structure:
For example, assuming the following remote tree structure:
 
<pre><nowiki>
<font size="-2">
     [http://www.majorleaguebaseball.com/ Baseball]
     [/web/20051110123327/http://www.majorleaguebaseball.com/ Baseball]
       |
       |
       *-- [/web/20051110123327/http://www.majorleaguebaseball.com/al/ American]
       *-- [http://www.majorleaguebaseball.com/al/ American]
       |    |
       |    |
       |    *-- [/web/20051110123327/http://www.majorleaguebaseball.com/al/bos/index.sml Red Sox]
       |    *-- [http://www.majorleaguebaseball.com/al/bos/index.sml Red Sox]
       |    |    |
       |    |    |
       |    |    *-- [/web/20051110123327/http://www.pawsox.com/ Pawtucket]
       |    |    *-- [http://www.pawsox.com/ Pawtucket]
       |    |    |
       |    |    |
       |    |    *-- [/web/20051110123327/http://www.trentonthunder.com/ Trenton]
       |    |    *-- [http://www.trentonthunder.com/ Trenton]
       |    |
       |    |
       |    *-- [/web/20051110123327/http://www.majorleaguebaseball.com/al/nyy/index.sml Yankees]
       |    *-- [http://www.majorleaguebaseball.com/al/nyy/index.sml Yankees]
       |        |
       |        |
       |        *-- [/web/20051110123327/http://www.clippersbaseball.com/ Columbus]
       |        *-- [http://www.clippersbaseball.com/ Columbus]
       |        |
       |        |
       |        *-- [/web/20051110123327/http://www.gators.com/ Norwich]
       |        *-- [http://www.gators.com/ Norwich]
       |
       |
       *-- [/web/20051110123327/http://www.majorleaguebaseball.com/nl/ National]
       *-- [http://www.majorleaguebaseball.com/nl/ National]
           |
           |
           *-- [/web/20051110123327/http://www.majorleaguebaseball.com/nl/ny/index.sml%22 Mets]
           *-- [http://www.majorleaguebaseball.com/nl/ny/index.sml%22 Mets]
           |    |
           |    |
           |    *-- [/web/20051110123327/http://www.piloton-line.com/tides/index.shtml Norfolk]
           |    *-- [http://www.piloton-line.com/tides/index.shtml Norfolk]
           |    |
           |    |
           |    *-- [/web/20051110123327/http://www.spectra.net/mall/bmets/ Binghampton]
           |    *-- [http://www.spectra.net/mall/bmets/ Binghampton]
           |
           |
           *-- [/web/20051110123327/http://www.majorleaguebaseball.com/nl/la/index.sml Dodgers]
           *-- [http://www.majorleaguebaseball.com/nl/la/index.sml Dodgers]
                 |
                 |
                 *-- [/web/20051110123327/http://www.nmia.com/~roberts/dukes.html Albuquerque]
                 *-- [http://www.nmia.com/~roberts/dukes.html Albuquerque]
                 |
                 |
                 *-- [/web/20051110123327/http://www.samissions.com/ San Antonio]
                 *-- [http://www.samissions.com/ San Antonio]
    </font>
</nowiki></pre>


Enterprise enabled versions of WebMaven could specify remote path values of ''Baseball/American/Red Sox''and ''Baseball/National/Dodgers.''and a local path of ''MLB''which would result in the following local tree structure on the local hard drive:
Enterprise enabled versions of WebMaven could specify remote path values of ''Baseball/American/Red Sox'' and ''Baseball/National/Dodgers.'' and a local path of ''MLB'' which would result in the following local tree structure on the local hard drive:
 
<pre><nowiki>
<font size="-2">
     MLB
     MLB
     |
     |
Line 88: Line 73:
               |
               |
               *-- San Antonio
               *-- San Antonio
    </font>
</nowiki></pre>


'''Note:''' [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#RemotePathsPerLocalTree Multiple remote paths] can only be specified with the enterprise edition.
'''Note:''' [http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#RemotePathsPerLocalTree Multiple remote paths] can only be specified with the enterprise edition.
 
</font>
|-
|-
| colspan="2" |
----
|- valign="top"
| nowrap="nowrap" | '''Out of tree'''
| nowrap="nowrap" | '''Out of tree'''
| <font size="-1"> Out of tree designates HTML links that are not within the remote path(s). What happens with out of tree links is detailed in the [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#ProtocolProcessingTable Protocol processing] table. </font>
| Out of tree designates HTML links that are not within the remote path(s). What happens with out of tree links is detailed in the [http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#ProtocolProcessingTable Protocol processing] table.
|-
| colspan="2" |
----
|}
|}


</center>
{|class="wikitable"
 
|+Feature by level: (default is underlined)
<center>
|-
 
!Function
{| width="100%" border="border" cellpadding="5" align="center"
!Unlicensed
|- align="left" valign="middle"
!Personal license
| colspan="1" | <font size="+1">'''Feature by level:'''</font>
!Enterprise license
| colspan="3" align="center" valign="middle" | <font size="-1">(default is underlined)</font>
|- valign="top"
| align="left" | '''Function'''
| align="center" | '''Unlicensed'''
| align="center" | '''Personal license'''
| align="center" | '''Enterprise license'''
|- valign="middle"
|- valign="middle"
| <font size="-1">Default file name</font>
| Default file name
| align="center" | <font size="-1">INDEX!.HTM</font>
| align="center" | INDEX!.HTM
| align="center" | <font size="-1"> <u>INDEX!.HTM</u> | user specified </font>
| align="center" | <u>INDEX!.HTM</u> | user specified  
| align="center" | <font size="-1"> <u>INDEX!.HTM</u> | user specified </font>
| align="center" | <u>INDEX!.HTM</u> | user specified
|- valign="middle"
|- valign="middle"
| <font size="-1">Maximum number of download subtasks</font>
| Maximum number of download subtasks
| align="center" | <font size="-1">1</font>
| align="center" | 1
| align="center" | <font size="-1">1-2; <u>2</u></font>
| align="center" | 1-2; <u>2</u>
| align="center" | <font size="-1">1-9; <u>3</u></font>
| align="center" | 1-9; <u>3</u>
|- valign="middle"
|- valign="middle"
| <font size="-1">Maximum download byte limit</font>
| Maximum download byte limit
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1">Full vs. relative localized paths</font>
| Full vs. relative localized paths
| align="center" | <font size="-1">full only</font>
| align="center" | full only
| align="center" | <font size="-1">relative only</font>
| align="center" | relative only
| align="center" | <font size="-1"><u>relative</u>|�full</font>
| align="center" | <u>relative</u>|full
|- valign="middle"
|- valign="middle"
| <font size="-1">HTTP client version</font>
| HTTP client version
| align="center" | <font size="-1">1.0 only</font>
| align="center" | 1.0 only
| align="center" | <font size="-1"><u>1.1</u>|�1.0</font>
| align="center" | <u>1.1</u>|1.0
| align="center" | <font size="-1"><u>1.1</u>|�1.0</font>
| align="center" | <u>1.1</u>|1.0
|- valign="middle"
|- valign="middle"
| <font size="-1">HTML priority load balancing</font>
| HTML priority load balancing
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1">Case sensitive URIs</font>
| Case sensitive URIs
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1">Useable with proxy server</font>
| Useable with proxy server
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1">[/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#MultipleRemotePathDescription Remote paths per local tree]</font>
| [http://www.toward.com/cfsrexx/WebMaven/techspecs.htm#MultipleRemotePathDescription Remote paths per local tree]
|
| align="center" | 1
| align="center" | <font size="-1">1</font>
| align="center" | 1
| align="center" | <font size="-1">1</font>
| align="center" | unlimited
| align="center" | <font size="-1">unlimited</font>
|- valign="middle"
|- valign="middle"
| <font size="-1">User ID / Password capable</font>
| User ID / Password capable
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
! colspan="4" align="center" | <font size="+1">Sample Reports</font><br /><font size="-1">([/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSummary.htm Sample reports])</font>
! colspan="4" align="center" | <font size="+1">Sample Reports<br />([http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSummary.htm Sample reports])
|- valign="top"
|-
| align="left" | '''Report Name'''
| align="left" | '''Report Name'''
| align="center" | '''Unlicensed'''
| align="center" | '''Unlicensed'''
Line 176: Line 146:
| align="center" | '''Enterprise license'''
| align="center" | '''Enterprise license'''
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportAged.htm Aged File List]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportAged.htm Aged File List]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportCookie.htm Cookie Report]<br /><font size="-2">(does not affect handling cookie requests)</font></font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportCookie.htm Cookie Report]<br /><font size="-2">(does not affect handling cookie requests)
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDNS.htm Domain Name Server Lookup Time]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDNS.htm Domain Name Server Lookup Time]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDomainException.htm Unresolved Domain Names] <sup>1</sup></font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDomainException.htm Unresolved Domain Names] <sup>1</sup>
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDownload.htm Download Time Report]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportDownload.htm Download Time Report]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportMailto.htm E-mail Addresses]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportMailto.htm E-mail Addresses]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportMimeType.htm Externally Processed MIME Types]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportMimeType.htm Externally Processed MIME Types]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSyntaxErrors.htm HTML Syntax Errors] <sup>1</sup></font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSyntaxErrors.htm HTML Syntax Errors] <sup>1</sup>
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportLinksException.htm Invalid HTML links] <sup>1</sup></font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportLinksException.htm Invalid HTML links] <sup>1</sup>
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportImageException.htm Image Exception Report]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportImageException.htm Image Exception Report]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportImageGroup.htm Image Group Report]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportImageGroup.htm Image Group Report]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportJavaClass.htm Java Class Report]<br /><font size="-2">(does not affect processing Java classes)</font></font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportJavaClass.htm Java Class Report]<br />(does not affect processing Java classes)
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportOutOfTree.htm Out Of Tree Links]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportOutOfTree.htm Out Of Tree Links]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>No</u>|�Yes</font>
| align="center" | <u>No</u>|Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportRelocation.htm Relocated URIs]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportRelocation.htm Relocated URIs]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>No</u>|�Yes</font>
| align="center" | <u>No</u>|Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSitemap.htm Site Map]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSitemap.htm Site Map]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>No</u>|�Yes</font>
| align="center" | <u>No</u>|Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSummary.htm Summary of WebMaven reports]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportSummary.htm Summary of WebMaven reports]
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
| align="center" | <font size="-1">Yes</font>
| align="center" | Yes
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportTitle.htm Titles of HTML Pages & Images]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportTitle.htm Titles of HTML Pages & Images]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>Yes</u>|�No</font>
| align="center" | <u>Yes</u>|No
|- valign="middle"
|- valign="middle"
| <font size="-1"> [/web/20051110123327/http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportXref.htm File Cross Reference Table]</font>
| [http://www.toward.com/cfsrexx/WebMaven/SampleReports/ReportXref.htm File Cross Reference Table]
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1">No</font>
| align="center" | No
| align="center" | <font size="-1"><u>No</u>|�Yes</font>
| align="center" | <u>No</u>|Yes
|- valign="middle"
|- valign="middle"
| colspan="4" | <font size="-2">'''Note 1:'''
| colspan="4" |
 
;Note 1:The user must confirm sending the e-mail report to the Webmaster.
The user must confirm sending the e-mail report to the Webmaster.
 
</font>
|}
|}


</center>
{|class="wikitable"
 
|+Protocol processing:
<center>
 
{| width="100%" border="border" cellpadding="5" align="center"
|- align="left" valign="middle"
| colspan="2" | <font size="+1">'''Protocol processing:'''</font>
|- valign="bottom"
|- valign="bottom"
| align="left" | '''Protocol'''
!align="left" |Protocol
| align="left" | '''WebMaven action'''
!align="left" |WebMaven action
|- valign="top"
|-
| <font size="-1">HTTP; FTP</font>
| HTTP; FTP
|
|
<font size="-1">Content-type=text/html:</font><br /><font size="-1"></font>
Content-type=text/html:<br />


<font size="-1">Content-type=(all others)</font><br /><font size="-1"></font>
Content-type=(all others)<br />
|- valign="top"
|-
| <font size="-1">MAILTO</font>
| MAILTO
| valign="bottom" | <font size="-1">Left unchanged (this will permit deferred delivery of mail messages).</font>
| valign="bottom" | Left unchanged (this will permit deferred delivery of mail messages).
|- valign="top"
|-
| <font size="-1">FILE; GOPHER; HTTPS; NEWS;<br />NNTP; TELNET; WAIS</font>
| FILE; GOPHER; HTTPS; NEWS;<br />NNTP; TELNET; WAIS
| <font size="-1">Creates an out of tree page.</font>
| Creates an out of tree page.
|- valign="top"
|-
| <font size="-1">PNM (Real Audio)</font>
| PNM (Real Audio)
| <font size="-1">Retrieves the referenced URI.</font>
| Retrieves the referenced URI.
|}
|}


</center>
{|class="wikitable"
 
|+HTTP response processing:
<center>
|-
 
{| width="100%" border="border" cellpadding="5" align="center"
|- align="left" valign="middle"
| colspan="2" | <font size="+1">'''HTTP response processing:'''</font>
|- valign="top"
| align="left" | '''HTTP Response'''
| align="left" | '''HTTP Response'''
| align="left" | '''WebMaven action'''
| align="left" | '''WebMaven action'''
|- valign="top"
|-
| align="left" | <font size="-1"> 300+ - Redirection </font>
| 300+ - Redirection  
| <font size="-1">Process redirected URI</font>
| Process redirected URI
|- valign="top"
|-
| align="left" | <font size="-1"> 400+ - Not found<br /> 500+ - Server error </font>
| 400+ - Not found<br /> 500+ - Server error  
|
|
<font size="-1">HTML expected:</font><br /><font size="-1"></font>
HTML expected:


<font size="-1">Image expected:</font><br /><font size="-1"></font>
Image expected:


[[Image:BadImage.gif|16px|Example of bad image gif]]
[Example of bad image gif]
|}
|}


</center>
{|class="wikitable"
 
|+WebMaven related files
<center>
|-
 
!File name
{| width="100%" border="border" cellpadding="5" align="center"
!Function
|- align="left" valign="middle"
|-
| colspan="2" | <font size="+1">'''WebMaven related files;'''</font>
| align="center" | WebMaven.CHK
|- valign="top"
|This is WebMaven's checkpoint / restart file. It is created in the local path if WebMaven terminates without finishing the retrieval of all files in the remote tree(s)  
| align="left" | '''File name'''
|-
| align="left" | '''Function'''
| align="center" | WebMave?.DMP
|- valign="top"
|In the event that WebMaven terminates abnormally (abends), a .DMP file is created in the WebMaven program directory. DMP files '''must''' be ZIP'ed and sent to Program Product Support when reporting the problem.
| align="center" | <font size="-1">WebMaven.CHK</font>
| <font size="-1"> This is WebMaven's checkpoint / restart file. It is created in the local path if WebMaven terminates without finishing the retrieval of all files in the remote tree(s) </font>
|- valign="top"
| align="center" | <font size="-1">WebMave?.DMP</font>
| <font size="-1"> In the event that WebMaven terminates abnormally (abends), a .DMP file is created in the WebMaven program directory. DMP files '''must''' be ZIP'ed and sent to Program Product Support when reporting the problem.


ZIP'ed .DMP files, along with other relevant material, can be e-mailed to [mailto:webmaven@cfsrexx.com product support] or they can be anonymously uploaded to ftp.cfsrexx.com/incoming/. Be sure to use a file name that is unique to you so that it will not conflict with any files uploaded by others.
ZIP'ed .DMP files, along with other relevant material, can be e-mailed to [mailto:webmaven@cfsrexx.com product support] or they can be anonymously uploaded to ftp.cfsrexx.com/incoming/. Be sure to use a file name that is unique to you so that it will not conflict with any files uploaded by others.
 
|-
</font>
| align="center" | WebMaven.LOG
|- valign="top"
|A WebMaven.LOG file is created / extended in the local path directory each time WebMaven is run. The contents of the .LOG file vary depending upon user-selected options.  
| align="center" | <font size="-1">WebMaven.LOG</font>
|-
| <font size="-1"> A WebMaven.LOG file is created / extended in the local path directory each time WebMaven is run. The contents of the .LOG file vary depending upon user-selected options. </font>
| align="center" | WebMaven.!!!
|- valign="top"
|This sentinel file exists in the local path while WebMaven is running.
| align="center" | <font size="-1">WebMaven.!!!</font>
| <font size="-1">This sentinel file exists in the local path while WebMaven is running.</font>
|}
|}


</center>
{|class="wikitable"
 
|+HTML Tag Processing
<center>
!HTML Tag
 
!Attributes processed
{| width="100%" border="1" cellpadding="5" align="center"
|-
|- align="left" valign="middle"
|<A>
| colspan="2" | <font size="+1">'''HTML Tag Processing'''</font>
| HREF
|- valign="top"
|-
| align="center" | '''HTML Tag'''
|<APPLET>
| align="center" | '''Attributes processed'''
| ARCHIVE; CODE; CODEBASE; PARAM
|- valign="top"
|-
| <font size="-1"><A></font>
|<AREA>
| <font size="-1">HREF</font>
| HREF
|- valign="top"
|-
| <font size="-1"><APPLET></font>
|<BASE>
| <font size="-1">ARCHIVE; CODE; CODEBASE; PARAM</font>
| HREF
|- valign="top"
|-
| <font size="-1"><AREA></font>
|<BGSOUND>
| <font size="-1">HREF</font>
| SRC
|- valign="top"
|-
| <font size="-1"><BASE></font>
|<BLOCKQUOTE&gt;
| <font size="-1">HREF</font>
| CITE
|- valign="top"
|-
| <font size="-1"><BGSOUND></font>
|<BODY>
| <font size="-1">SRC</font>
| BACKGROUND; STYLESRC
|- valign="top"
|-
| <font size="-1"><BLOCKQUOTE></font>
|<DEL&gt;
| <font size="-1">CITE</font>
| CITE
|- valign="top"
|-
| <font size="-1"><BODY></font>
|<EMBED>
| <font size="-1">BACKGROUND; STYLESRC</font>
| SRC
|- valign="top"
|-
| <font size="-1"><DEL></font>
|<FORM>
| <font size="-1">CITE</font>
| ACTION; INPUT
|- valign="top"
|-
| <font size="-1"><EMBED></font>
|<FRAME>
| <font size="-1">SRC</font>
| LONGDESC; SRC
|- valign="top"
|-
| <font size="-1"><FORM></font>
|<HEAD>
| <font size="-1">ACTION; INPUT</font>
| PROFILE
|- valign="top"
|-
| <font size="-1"><FRAME></font>
|<IFRAME>
| <font size="-1">LONGDESC; SRC</font>
| LONGDESC; SRC
|- valign="top"
|-
| <font size="-1"><HEAD></font>
|<IMG>
| <font size="-1">PROFILE</font>
| LONGDESC; LOWSRC; SRC; USEMAP
|- valign="top"
|-
| <font size="-1"><IFRAME></font>
|<INPUT>
| <font size="-1">LONGDESC; SRC</font>
| SRC; USEMAP
|- valign="top"
|-
| <font size="-1"><IMG></font>
|<INS&gt;
| <font size="-1">LONGDESC; LOWSRC; SRC; USEMAP</font>
| CITE
|- valign="top"
|-
| <font size="-1"><INPUT></font>
|<INPUT>
| <font size="-1">SRC; USEMAP</font>
| SRC; USEMAP
|- valign="top"
|-
| <font size="-1"><INS></font>
|<LINK>
| <font size="-1">CITE</font>
| HREF
|- valign="top"
|-
| <font size="-1"><INPUT></font>
|<META>
| <font size="-1">SRC; USEMAP</font>
| HTTP-EQUIV
|- valign="top"
|-
| <font size="-1"><LINK></font>
|<OBJECT>
| <font size="-1">HREF</font>
| ARCHIVE; CLASSID; CODEBASE; DATA; PARAM; USEMAP
|- valign="top"
|-
| <font size="-1"><META></font>
|<OPTGROUP>
| <font size="-1">HTTP-EQUIV</font>
| VALUE
|- valign="top"
|-
| <font size="-1"><OBJECT></font>
|<OPTION>
| <font size="-1">ARCHIVE; CLASSID; CODEBASE; DATA; PARAM; USEMAP</font>
| VALUE
|- valign="top"
|-
| <font size="-1"><OPTGROUP></font>
|<PARAM>
| <font size="-1">VALUE</font>
| VALUE
|- valign="top"
|-
| <font size="-1"><OPTION></font>
|<Q>
| <font size="-1">VALUE</font>
| CITE
|- valign="top"
|-
| <font size="-1"><PARAM></font>
|<SCRIPT>
| <font size="-1">VALUE</font>
| SRC
|- valign="top"
| <font size="-1"><Q></font>
| <font size="-1">CITE</font>
|- valign="top"
| <font size="-1"><SCRIPT></font>
| <font size="-1">SRC</font>
|}
 
</center>
|}
|}


</center>
[[Category:WebMaven]]
 
[[Category:Software]]

Latest revision as of 02:28, 3 June 2018

Definition of terms
In order to fully understand the material below, it is necessary to specify some of the jargon used with WebMaven.
Term Definition
URI WebMaven uses the term URI to encompass URLs along with other associated data necessary to reference a file via the HTTP protocol. From RFC 2068:

URIs have been known by many names: WWW addresses, Universal Document Identifiers, Universal Resource Identifiers , and finally the combination of Uniform Resource Locators (URL) and Names (URN). As far as HTTP is concerned, Uniform Resource Identifiers are simply formatted strings which identify -- via name, location, or any other characteristic -- a resource.

Local path A remote site, be it a complete domain (e.g. www.cfsrexx.com) or one or more paths within a remote domain (e.g. www.cfsrexx.com/pub/ & www.cfsrexx.com/WebMaven/) are downloaded into the local path directory.

Note: Multiple remote paths can only be specified with a the enterprise edition.

Remote path Remote path is a domain name, with or without a path. The remote path corresponds to the local path on a one-to-one basis when only one remote path is specified.

When more than one remote path is specified, each directory in the remote path corresponds, one-for-one, with a local directory subordinate to the local path. Multiple remote paths can include the same or different domains and protocols.

For example, assuming the following remote tree structure:

    [http://www.majorleaguebaseball.com/ Baseball]
      |
      *-- [http://www.majorleaguebaseball.com/al/ American]
      |    |
      |    *-- [http://www.majorleaguebaseball.com/al/bos/index.sml Red Sox]
      |    |    |
      |    |    *-- [http://www.pawsox.com/ Pawtucket]
      |    |    |
      |    |    *-- [http://www.trentonthunder.com/ Trenton]
      |    |
      |    *-- [http://www.majorleaguebaseball.com/al/nyy/index.sml Yankees]
      |         |
      |         *-- [http://www.clippersbaseball.com/ Columbus]
      |         |
      |         *-- [http://www.gators.com/ Norwich]
      |
      *-- [http://www.majorleaguebaseball.com/nl/ National]
           |
           *-- [http://www.majorleaguebaseball.com/nl/ny/index.sml%22 Mets]
           |    |
           |    *-- [http://www.piloton-line.com/tides/index.shtml Norfolk]
           |    |
           |    *-- [http://www.spectra.net/mall/bmets/ Binghampton]
           |
           *-- [http://www.majorleaguebaseball.com/nl/la/index.sml Dodgers]
                |
                *-- [http://www.nmia.com/~roberts/dukes.html Albuquerque]
                |
                *-- [http://www.samissions.com/ San Antonio]

Enterprise enabled versions of WebMaven could specify remote path values of Baseball/American/Red Sox and Baseball/National/Dodgers. and a local path of MLB which would result in the following local tree structure on the local hard drive:

    MLB
     |
     *-- American
     |    |
     |    *-- Red Sox
     |         |
     |         *-- Pawtucket
     |         |
     |         *-- Trenton
     |
     *-- National
          |
          *-- Dodgers
               |
               *-- Albuquerque
               |
               *-- San Antonio

Note: Multiple remote paths can only be specified with the enterprise edition.

Out of tree Out of tree designates HTML links that are not within the remote path(s). What happens with out of tree links is detailed in the Protocol processing table.
Feature by level: (default is underlined)
Function Unlicensed Personal license Enterprise license
Default file name INDEX!.HTM INDEX!.HTM | user specified INDEX!.HTM | user specified
Maximum number of download subtasks 1 1-2; 2 1-9; 3
Maximum download byte limit Yes Yes Yes
Full vs. relative localized paths full only relative only relative|full
HTTP client version 1.0 only 1.1|1.0 1.1|1.0
HTML priority load balancing No Yes|No Yes|No
Case sensitive URIs No Yes|No Yes|No
Useable with proxy server No Yes Yes
Remote paths per local tree 1 1 unlimited
User ID / Password capable No Yes Yes
Sample Reports
(Sample reports)
Report Name Unlicensed Personal license Enterprise license
Aged File List No No Yes|No
Cookie Report
(does not affect handling cookie requests)
No Yes|No Yes|No
Domain Name Server Lookup Time No No Yes|No
Unresolved Domain Names 1 Yes Yes Yes
Download Time Report No No Yes|No
E-mail Addresses No No Yes|No
Externally Processed MIME Types No No Yes|No
HTML Syntax Errors 1 Yes Yes Yes
Invalid HTML links 1 Yes Yes Yes
Image Exception Report No Yes|No Yes|No
Image Group Report No Yes|No Yes|No
Java Class Report
(does not affect processing Java classes)
No No Yes|No
Out Of Tree Links No No No|Yes
Relocated URIs No No No|Yes
Site Map No No No|Yes
Summary of WebMaven reports Yes Yes Yes
Titles of HTML Pages & Images No No Yes|No
File Cross Reference Table No No No|Yes
Note 1
The user must confirm sending the e-mail report to the Webmaster.
Protocol processing:
Protocol WebMaven action
HTTP; FTP

Content-type=text/html:

Content-type=(all others)

MAILTO Left unchanged (this will permit deferred delivery of mail messages).
FILE; GOPHER; HTTPS; NEWS;
NNTP; TELNET; WAIS
Creates an out of tree page.
PNM (Real Audio) Retrieves the referenced URI.
HTTP response processing:
HTTP Response WebMaven action
300+ - Redirection Process redirected URI
400+ - Not found
500+ - Server error

HTML expected:

Image expected:

[Example of bad image gif]

WebMaven related files
File name Function
WebMaven.CHK This is WebMaven's checkpoint / restart file. It is created in the local path if WebMaven terminates without finishing the retrieval of all files in the remote tree(s)
WebMave?.DMP In the event that WebMaven terminates abnormally (abends), a .DMP file is created in the WebMaven program directory. DMP files must be ZIP'ed and sent to Program Product Support when reporting the problem.

ZIP'ed .DMP files, along with other relevant material, can be e-mailed to product support or they can be anonymously uploaded to ftp.cfsrexx.com/incoming/. Be sure to use a file name that is unique to you so that it will not conflict with any files uploaded by others.

WebMaven.LOG A WebMaven.LOG file is created / extended in the local path directory each time WebMaven is run. The contents of the .LOG file vary depending upon user-selected options.
WebMaven.!!! This sentinel file exists in the local path while WebMaven is running.
HTML Tag Processing
HTML Tag Attributes processed
<A> HREF
<APPLET> ARCHIVE; CODE; CODEBASE; PARAM
<AREA> HREF
<BASE> HREF
<BGSOUND> SRC
<BLOCKQUOTE> CITE
<BODY> BACKGROUND; STYLESRC
<DEL> CITE
<EMBED> SRC
<FORM> ACTION; INPUT
<FRAME> LONGDESC; SRC
<HEAD> PROFILE
<IFRAME> LONGDESC; SRC
<IMG> LONGDESC; LOWSRC; SRC; USEMAP
<INPUT> SRC; USEMAP
<INS> CITE
<INPUT> SRC; USEMAP
<LINK> HREF
<META> HTTP-EQUIV
<OBJECT> ARCHIVE; CLASSID; CODEBASE; DATA; PARAM; USEMAP
<OPTGROUP> VALUE
<OPTION> VALUE
<PARAM> VALUE
CITE
<SCRIPT> SRC