[1st-mile-nm] NM Broadband Map

Wed Jun 13 17:06:56 PDT 2012

BROADBANDERS:

Richard, do appreciate your correct thinking below, and the opportunity to respond to these "enriched" comments. My taps are lengthy.  However, I want to be sure the hard points have been hit.

First, I want to say out loud the following two points:

1.    The New Mexico Broadband Map is inaccurate and does over report availability

2.    The New Mexico Broadband Map is the most accurate up to date illustration of NM Broadband Availability in the universe.

With that noted, I’ll provide some explanation.

Accuracy:  The following bullets describe the data sources, processing, and deployment steps.  As such, they make reference to the constraints we have to operate within.

·       Data Sources:  The data used to create the map are acquired directly from each provider under the watch of Non Disclosure Agreements (NDA).  A tragic oversight is that there were no rigid data source standard requirements.  Hence, we receive data that includes service area, customer addresses, census geography, and spectrum attributes.  These come in various forms such as spreadsheets, GIS Files, hand drawn PDF, CAD Drawing Files, online screen captures, and other assorted media.

·       Process:  These data are “normalized” as best we can into the “Geodatabase Schema” requirements of the NTIA using a Data Processing Methodology (attached).  To protect the interest of the Provider, we are required by NTIA to aggregate data into Census Blocks for those “blocks” less than 2 square miles and snap data to road segments in those areas where Census Blocks are greater than 2 square miles.  A near impossible feat in rural areas without mapped roads.  My opinion, a bad requirement that causes over reporting.  These are the data that are displayed on the NTIA Broadband Map.  Note in creating these requirements NTIA was under a bunch of restrictive structure as well.  Hence, getting this far was rather miraculous.

·       NM Display:  We chose to display data differently on our NM BB Map by using all Census Blocks.  Yes, this over reports these data, yet is easier for folks to understand rather than adopting an Dispersion Model from road segments that is being proposed.  To tighten up the accuracy of our State Data we are implementing the following new processes:

o   Radio Propagation Models:  The last NTIA and NM Display of data include “Radio Propagation Modeling” of data from providers who kindly pushed that to us.  So, to improve the mobile wireless coverage on rural lands, we’d do a better job if the technical specs were given to us by the providers.  Otherwise, we have to make do with the large area “polygons” submitted to us.

o   NM Land Index:  DoIT and the State Land Office created the NM Land Index that is essentially a One Square Mile Grid thrown onto the State.  We will apply this grid to provider reported data in rural areas.  This process will more accurately represent provider customer/service area.  Note service area is defined as being able to provide customer service within 10 (ten) days.

o   Spatial Analyses:  Recently we demonstrated a process that will increase accuracy that removes from a service area those “census blocks” with zero (0) population after verifying with digital data supplied by E911 “Structure Mapping” and Assessor Data.  The process works and now the BB Team is determining an automation path.

o   Providers:  Another flaw in this program is the lack of requirements for Providers to participate.  Some of the loudest critics are those that have chosen not to submit their data.  However, we do have participation from most of the major providers both larger national companies and our very active and community minded rural telecoms.

Verification:  The statement that “there is little or no verification of the data” is absolutely correct.  To conduct a “policing” task when we’ve got to operate with the above mentioned conditions is wasted effort.  Most of the providers are making a concerted effort to provide accurate data to this project.  I am inclined to believe the providers and tackle the error when reported.  However, what “little” we are doing is:

·       Mobile Wireless:  With the assistance of two independent verification sources that use different Propagation Software than the NM BB Program, we will be acquiring validation results to compare with our results.

·       Public Comment:  The NM BB Team receive public and business inquiry reporting improvements to our data.  These are logged, researched, and if not due to an aggregation/processing requirement are reported to the provider with a request to correct the error.  Most times the providers are very conscious in making the change or providing additional data.

·       Feedback:  Following processing the data, each provider is given a “Feedback” document that includes data and a “smart” or layered PDF map for review and approval previous to uploading to NTIA and updating our NM BB Map.  This transaction is submitted via a secure passcode protected ftpsite.

·       Crowd Sourcing:  The NM BB Team is beta testing a crowd sourcing application.  This is an online method where individuals can submit corrections (location and content) to data based on their area expertise.  We are investigating this technology with some of the providers on the “source” side and will deploy a similar application for public use.  More information can be gleaned from the following site that highlights Community Anchor Institution (CAI) data:

- http://www.doit.state.nm.us/broadband/surveys.shtml

I want to emphasize that the "Broadband Map" is not a "demonic jocular" project, yet the intent is to have this morph into a useful tool for an industry, public, and government collaborative to acquire, plan, and implement services.  The accuracy is dependent on all of these communities participating.

Any questions, comments, and/or thoughtful ruminations; please contact me directly.

Thank You,  Gar Clarke

Gar Clarke
Broadband Program Manager
Department of Information Technology
Simms Building
715 Alta Vista Street
Santa Fe, New Mexico 87505
Email:  george.clarke at state.nm.us<mailto:george.clarke at state.nm.us>
Desk:  505.827-1663
Cell:  505.690-1661
Fax:  505.827-2325
BB Web:  http://www.doit.state.nm.us/broadband/

-----Original Message-----

From: 1st-mile-nm-bounces at mailman.dcn.org<mailto:1st-mile-nm-bounces at mailman.dcn.org> [mailto:1st-mile-nm-bounces at mailman.dcn.org]<mailto:[mailto:1st-mile-nm-bounces at mailman.dcn.org]> On Behalf Of Richard Lowenberg

Sent: Monday, June 11, 2012 11:11 AM

To: 1st-mile-nm at mailman.dcn.org<mailto:1st-mile-nm at mailman.dcn.org>

Subject: Re: [1st-mile-nm] NM Broadband Map

I hope that Gar Clarke may respond, or that others involved in the

NTIA funded 'Broadband Mapping' projects may do so.

I am familiar with the program, but am not directly involved.

However, it is my understanding that over the five year process,

(we are two years in) initial service data is being garnered from

the telecom providers.  In order to assure accuracy and veracity of

data,

the State teams are also to design and implement user surveys,

crowd-sourced data gathering and other means to attempt greater mapping

accuracy.

This is especially difficult, but necessary, in the rural areas of the

state.

RL

On 11.06.2012 10:37, Marks, Jason, PRC wrote:

> Nice tool, but it may overstate coverage.   The area surrounding my

> residence is shown with solid green, but DSL is not in fact available

> (last time I checked) due to excessive distance from the QCL

> wirecenter and no Remote DSLAM.   I am wondering whether the mapping

> database assumes that QCL (and Windstream) service territory is

> served, regardless of the circumstances of the specific location.

>

> Jason Marks

> ________________________________________

> From: 1st-mile-nm-bounces at mailman.dcn.org<mailto:1st-mile-nm-bounces at mailman.dcn.org>

> [1st-mile-nm-bounces at mailman.dcn.org] on behalf of Richard Lowenberg

> [rl at 1st-mile.com]

> Sent: Wednesday, June 06, 2012 8:18 PM

> To: 1st mile nm

> Subject: [1st-mile-nm] NM Broadband Map

>

> The following was posted by Gar Clark, NM DoIT Geospatial Program

> Manager,

> to the NM GAC list:

>

> NEW MEXICO BROADBAND MAP – New Functionality:  Gar Clarke, DoIT

> Please take a look at the latest version of the New Mexico Broadband

> Map.  The Broadband Team has taken steps to create a more accurate

> picture of Broadband Availability within the State by using a radio

> propagation modeling software.  In addition, spatial analysis tools

> coupled with a soon to be released New Mexico Lands Index Grid will

> be

> implemented to merge population statistics with structures to depict

> more accurately areas of Broadband Availability.  Other enhancements

> include improvements to the instructions and a function that informs

> on

> population, households, income, and poverty estimates.  Also, please

> take a look at the Broadband Portal additions that include updated

> County Broadband Availability Maps and Statistics.  Note that these

> maps

> are “Layered” PDF, meaning some “features” can be turned off and on.

> Lastly, we have added two videos featuring an Overview of the Program

> and another speaking to Broadband for Education.  Have a look….

>

> NM Broadband Portal:  http://www.doit.state.nm.us/broadband/

> Broadband Videos:  http://www.doit.state.nm.us/broadband/video.shtml

> County Maps:

> http://www.doit.state.nm.us/broadband/map_county_availability.shtml

> Broadband Map:  http://nmbbmapping.org/mapping/

>

>

> --------------------------------

> Richard Lowenberg

> 1st-Mile Institute

> Box 8001, Santa Fe, NM 87504

> 505-989-9110 / 505-603-5200

> www.1st-mile.com<http://www.1st-mile.com>   rl at 1st-mile.com<mailto:rl at 1st-mile.com>

> --------------------------------

>

_______________________________________________

1st-mile-nm mailing list

1st-mile-nm at mailman.dcn.org<mailto:1st-mile-nm at mailman.dcn.org>

http://www2.dcn.org/mailman/listinfo/1st-mile-nm
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www2.dcn.org/pipermail/1st-mile-nm/attachments/20120614/1ca10afb/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NM_BB_Methodology_2012_04_01.pdf
Type: application/pdf
Size: 739079 bytes
Desc: NM_BB_Methodology_2012_04_01.pdf
URL: <http://www2.dcn.org/pipermail/1st-mile-nm/attachments/20120614/1ca10afb/attachment.pdf>