Snowflake Marketplace

Federal Buying Signals: Forecasts, Subawards and Labor Rates

What federal agencies plan to buy, from DHS and the GSA Acquisition Gateway, with GSA’s ceiling rates for every labor category on the Multiple Award Schedule and 7,335,883 reported federal subawards from fiscal 2016 through 2027, plus 6,293,287 state and city contract awards and the organizations doing business with New York City, updated weekly.

12,819forecasts
346,801labor rates
6tables
Weeklyupdated
About this dataset

What’s in the listing

A forecast is an agency’s public notice of a purchase it plans to make, usually months before the solicitation. DHS publishes its forecasts in the Acquisition Planning Forecast System (planned buys over $250,000). The GSA Acquisition Gateway publishes forecasts from ten civilian agencies, with Interior, Agriculture and Commerce the largest. Civly reads both every week into one table, FORECASTS, with an estimated value range, NAICS code, set-aside, incumbent and planned award date where the agency gives them. A forecast that drops off a feed stays in the table, flagged.

LABOR_RATES has GSA’s CALC+ ceiling rates: the most each Multiple Award Schedule contractor may bill per hour for each labor category, with next-year and second-year prices.

SUBAWARDS adds 7,335,883 reports of federal subcontracts and subgrants from USASpending.gov, fiscal 2016 through 2027. Rows identify the prime recipient and subrecipient, their Unique Entity IDs (UEIs), the amount, agency, dates and work description. Revised reports are retained and marked.

STATE_CONTRACT_AWARDS adds 6,293,287 state and city contracts, purchase orders and awards from seven sources: the District of Columbia’s PASS contracts and purchase orders, Delaware, Virginia’s eVA system (fiscal 2018 on), the New Mexico Sunshine Portal (purchases from July 2021), Nevada ePro and Louisiana Checkbook. Rows name the vendor, the agency, the amount, the dates and what was bought, mapped into one set of columns. Coverage is limited to these seven sources. Other states are not included yet.

NYC_DOING_BUSINESS_ORGANIZATIONS and NYC_DOING_BUSINESS_PEOPLE list the 10,787 organizations New York City records as doing business with it and their 60,545 principals, by name and role, from NYC Doing Business (Mayor’s Office of Contract Services).

Common uses: building a federal sales pipeline (what is coming, when, how large, which set-aside, who holds the current contract), tracking recompetes, finding teaming partners and competitors, pricing a bid against published ceiling rates, and seeing who already sells to state agencies and to New York City.

FactDetail
SourceFederal: DHS Acquisition Planning Forecast System, GSA Acquisition Gateway forecast tool, GSA CALC+ ceiling rates, and USASpending.gov federal subaward reports, all U.S. government works. State and city: District of Columbia PASS contracts and purchase orders (Office of Contracting and Procurement), Delaware contracts, Virginia eVA (Department of General Services), New Mexico Sunshine Portal purchases, Nevada ePro contracts and Louisiana Checkbook contracts. New York City: NYC Doing Business (Mayor’s Office of Contract Services)
CoverageForecasts from DHS and the ten civilian agencies on the Acquisition Gateway. Ceiling rates for every labor category on the Multiple Award Schedule. Federal subcontract and subgrant reports from fiscal 2016 through 2027. State and city contract awards from the District of Columbia, Delaware, Virginia (fiscal 2018 on), New Mexico (from July 2021), Nevada and Louisiana only. Organizations doing business with New York City and their principals
RefreshWeekly
Free trial30 days: the DHS forecasts (SOURCE = 'dhs_apfs'), the labor rates whose CATEGORY includes Facilities, fiscal 2016 subawards (659,070 reports), and the Delaware, Nevada and Louisiana contract awards (15,241 rows). The NYC Doing Business tables return no rows during the trial
SubscriptionEvery forecast, labor rate, subaward fiscal year and state contract source, plus both NYC Doing Business tables
Join keyForecasts and labor rates share no key. FORECASTS.NORM_INCUMBENT_NAME and LABOR_RATES.NORM_VENDOR_NAME use the same name rule, so a forecast’s incumbent can be matched to its ceiling rates. NYC_DOING_BUSINESS_PEOPLE joins NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME. The state contract and NYC tables share no id with the federal tables. Match them by name.
Permitted useNot for employment, tenant, credit, insurance or licensing decisions about a person.
Coverage

How much is in each table

Row counts checked October 27, 2026. State contract and NYC Doing Business counts checked November 15, 2026. Counts include superseded subaward reports.

TableSourceRowsFree trial
FORECASTSDHS Acquisition Planning Forecast System (dhs_apfs)666Included
FORECASTSGSA Acquisition Gateway, ten civilian agencies (acquisition_gateway)12,153Subscription only
LABOR_RATESGSA CALC+ ceiling rates, Multiple Award Schedule346,801Categories that include Facilities
SUBAWARDSUSASpending.gov, fiscal 2016 through 20277,335,883Fiscal 2016 only: 659,070 reports
STATE_CONTRACT_AWARDSDistrict of Columbia PASS contracts (dc_contracts)20,108Subscription only
STATE_CONTRACT_AWARDSDistrict of Columbia PASS purchase orders (dc_purchase_orders)255,170Subscription only
STATE_CONTRACT_AWARDSDelaware contracts (de_contracts)1,043Included
STATE_CONTRACT_AWARDSVirginia eVA, fiscal 2018 on (va_eva)5,559,637Subscription only
STATE_CONTRACT_AWARDSNew Mexico Sunshine Portal purchases, from July 2021 (nm_sunshine_purchases)443,131Subscription only
STATE_CONTRACT_AWARDSNevada ePro contracts (nv_nevadaepro_contracts)4,292Included
STATE_CONTRACT_AWARDSLouisiana Checkbook contracts (la_checkbook_contracts)9,906Included
NYC_DOING_BUSINESS_ORGANIZATIONSNYC Doing Business, Mayor’s Office of Contract Services10,787Subscription only
NYC_DOING_BUSINESS_PEOPLENYC Doing Business, Mayor’s Office of Contract Services60,545Subscription only

Reading the data

A forecast is a plan, not an award, a solicitation or a promise to buy. Agencies change dates, values and set-asides, or drop the purchase. The binding terms come with the solicitation on SAM.gov.

Use LISTED_IN_LATEST_FEED = TRUE for what agencies plan now. A forecast that leaves a feed stays with LISTED_IN_LATEST_FEED = FALSE. FIRST_SEEN_DATE and LAST_SEEN_DATE are the dates of Civly’s weekly reads, not the agency’s dates.

DHS gives an exact planned award date. The Acquisition Gateway usually gives a fiscal year and sometimes a quarter. PLANNED_AWARD_WINDOW_START and PLANNED_AWARD_WINDOW_END let you filter both together.

Dates outside 2015 to 2060 are typing errors or placeholders in the source (such as 2099-09-08) and are left empty, never corrected.

A ceiling rate is the most a vendor may bill per hour for a labor category on that contract. Actual task-order prices are often lower. Labor category names are the vendors’ own wording, so compare within SIN or CATEGORY and read EDUCATION_LEVEL and MIN_YEARS_EXPERIENCE beside the price.

Subawards are reports from prime recipients. Revisions can repeat a subaward. Use IS_LATEST_REPORT = TRUE to count the newest report and AMOUNT_SUSPECT = FALSE before adding dollars. Flagged amounts fail Civly’s checks and remain in the file with a reason. The FISCAL_YEAR file year and SUBAWARD_ACTION_DATE_FISCAL_YEAR may differ.

In STATE_CONTRACT_AWARDS, AMOUNT means different things by source. Read AMOUNT_KIND before adding dollars, and do not add amounts of different kinds together: award_max is a contract’s value, po_total is a purchase order’s total, and spent_to_date is what has been spent under a contract so far, not its value.

NYC Doing Business prints its dates with short years, such as 07/03/0017 for a 2017 date. DOING_BUSINESS_START_DATE and DOING_BUSINESS_END_DATE are Civly’s reading of them as dates. The city’s own text is kept in the _AS_PUBLISHED columns.

Schemas

Data dictionary

Six tables, 187 columns in total: FORECASTS, LABOR_RATES, SUBAWARDS, STATE_CONTRACT_AWARDS, NYC_DOING_BUSINESS_ORGANIZATIONS and NYC_DOING_BUSINESS_PEOPLE. The same tables serve the trial and the subscription. During the free trial, FORECASTS returns the DHS forecasts, LABOR_RATES returns the categories that include Facilities, SUBAWARDS returns fiscal 2016, and STATE_CONTRACT_AWARDS returns the Delaware, Nevada and Louisiana rows. The two NYC Doing Business tables return no rows during the trial. A subscription adds the Acquisition Gateway forecasts, every other labor category, all subaward fiscal years, the District of Columbia, Virginia and New Mexico contract rows, and both NYC Doing Business tables.

Schema

Data dictionary: FORECASTS

One row per forecast, from either source, with SOURCE and AGENCY columns. Text is kept as published apart from the columns marked as Civly’s. Named agency contacts are not included. 52 columns.

ColumnTypeMeaning
SOURCE_ROW_NUMBERNUMBERPosition of the row in Civly’s weekly file.
ACQUISITION_PHASETEXTAcquisition Gateway only: the purchase’s stage, as published.
ADDITIONAL_INFORMATIONTEXTAcquisition Gateway only: the agency’s added notes. Typed-in email addresses are replaced with [email removed].
AGENCYTEXTDepartment of Homeland Security for DHS forecasts. For Acquisition Gateway forecasts, the agency that published it.
CONTRACT_TYPETEXTPlanned contract type, as published.
CONTRACT_VEHICLETEXTPlanned contract vehicle or buying method, as published.
CONTRACTING_AGENCYTEXTAcquisition Gateway only: the agency that will award the contract.
CONTRACTING_OFFICETEXTThe office that will award the contract.
CURRENT_CONTRACT_END_DATEDATEAcquisition Gateway only: when the current contract ends, when listed.
DESCRIPTIONTEXTThe agency’s description of the purchase. Typed-in email addresses are replaced with [email removed].
ESTIMATED_VALUE_MAX_USDNUMBERCivly’s reading of the upper dollar amount in ESTIMATED_VALUE_RANGE. Empty for open-ended bands such as Over $100M, or when the label has no amount Civly can read.
ESTIMATED_VALUE_MIN_USDNUMBERThe lower dollar amount in the band, read the same way. 0 for bands such as Below $150K.
ESTIMATED_VALUE_RANGETEXTThe agency’s value band, as published. A band, not a budget or an expected price.
EXTENT_COMPETEDTEXTAcquisition Gateway only: planned competition, as published.
FORECAST_IDTEXTThe agency’s own forecast number (the APFS number for DHS).
INCUMBENT_CONTRACT_NUMBERTEXTCurrent contract number, when the agency lists one. Several are joined as a; b.
INCUMBENT_NAMETEXTCurrent contractor, when listed. Placeholders such as TBD and N/A are left out, and several names are joined as a; b. Typed-in email addresses are replaced with [email removed].
NAICS_CODETEXTIndustry code (NAICS). The Acquisition Gateway shows only the first when a forecast has several.
NAICS_CODE_COUNTNUMBERHow many NAICS codes the agency listed.
NAICS_DESCRIPTIONTEXTIndustry name, as published.
NORM_INCUMBENT_NAMETEXTCivly’s normalized incumbent name, each name normalized separately, for matching. Same rule as LABOR_RATES.NORM_VENDOR_NAME.
ORGANIZATIONTEXTThe agency component or funding organization, as published.
PERIOD_OF_PERFORMANCE_ENDDATEPlanned end of the work.
PERIOD_OF_PERFORMANCE_STARTDATEPlanned start of the work.
PLACE_OF_PERFORMANCE_CITYTEXTEvery city the forecast lists, as a; b. Not lined up with the state and country columns.
PLACE_OF_PERFORMANCE_COUNTNUMBERHow many places the forecast lists. Empty when the agency says the place cannot be disclosed.
PLACE_OF_PERFORMANCE_COUNTRYTEXTEvery country the forecast lists, as a; b.
PLACE_OF_PERFORMANCE_STATETEXTEvery state the forecast lists, as a; b. A nationwide forecast lists all 62 states and territories.
PLANNED_AWARD_DATEDATEDHS only: the planned award date.
PLANNED_AWARD_FISCAL_YEARNUMBERFederal fiscal year of the planned award. A fiscal year runs October 1 to September 30.
PLANNED_AWARD_QUARTERNUMBERFiscal quarter of the planned award, when given.
PLANNED_AWARD_WINDOW_ENDDATEEnd of the planned award window (see PLANNED_AWARD_WINDOW_START).
PLANNED_AWARD_WINDOW_STARTDATECivly’s column, so both sources can be filtered together: the exact planned date when published, otherwise the fiscal quarter, otherwise the whole fiscal year. Empty when the agency gave no award year.
PLANNED_SOLICITATION_DATEDATEWhen the agency plans to post the solicitation.
REQUIREMENT_TYPETEXTCivly’s mapping of the agency’s wording: new, recompete (a follow-on to an existing contract), option_exercise (Acquisition Gateway only), no_longer_required (DHS only) or other. Empty when the agency gave none.
REQUIREMENT_TYPE_AS_PUBLISHEDTEXTThe agency’s own wording.
REQUIREMENTS_OFFICETEXTThe office that needs the purchase.
SET_ASIDETEXTSmall-business set-aside, in the agency’s wording (SB is small business, TBD is to be determined).
SET_ASIDE_EXTENTTEXTDHS only: full or partial.
SOLICITATION_URLTEXTAcquisition Gateway only: link to the solicitation, when posted.
SOURCETEXTdhs_apfs or acquisition_gateway. The trial returns dhs_apfs.
SOURCE_CREATED_DATEDATEWhen the agency created the forecast.
SOURCE_RECORD_IDTEXTThe source system’s id for the forecast. Unique together with SOURCE.
SOURCE_UPDATED_DATEDATEWhen the agency last changed the forecast.
TITLETEXTForecast title.
SOURCE_URLTEXTThe feed the row was read from.
SOURCE_SHA256TEXTChecksum of the file read.
SOURCE_RELEASE_DATEDATEDate of the read.
FIRST_SEEN_DATEDATEDate of the first weekly read that found the forecast. Civly’s date, not the agency’s.
LAST_SEEN_DATEDATEDate of the latest weekly read that found the forecast.
LISTED_IN_LATEST_FEEDBOOLEANTrue when the latest read found the forecast. False means it has left the feed since LAST_SEEN_DATE, often because the solicitation was posted or the plan was dropped. It does not mean the contract was awarded.
IMPORTED_ATTIMESTAMP_NTZWhen Civly imported the row.
Schema

Data dictionary: LABOR_RATES

One row per labor category on one vendor’s GSA schedule contract, from one nightly CALC+ build. 26 columns.

ColumnTypeMeaning
SOURCE_ROW_NUMBERNUMBERPosition of the row in Civly’s weekly file.
BUSINESS_SIZETEXTS for a small business, O for other than small.
CATEGORYTEXTMultiple Award Schedule category, as published. The trial returns categories that include Facilities.
CONTRACT_ENDDATEContract end date.
CONTRACT_NUMBERTEXTGSA contract number. One contract carries many rates, and one vendor can hold several contracts.
CONTRACT_STARTDATEContract start date.
CONTRACT_TERMINATION_DATEDATEPublished by CALC+ without a definition and set on few contracts. Read it as published.
CURRENT_PRICENUMBERCeiling hourly rate for the contract’s current year, dollars: the most the vendor may bill, not a price anyone paid.
DATA_SOURCETEXTCALC+’s own source label for the rate, as published.
EDUCATION_LEVELTEXTMinimum education for the labor category, in the vendor’s wording.
LABOR_CATEGORYTEXTThe vendor’s name for the job. The same job appears under many names.
MIN_YEARS_EXPERIENCENUMBERMinimum years of experience the vendor sets for the category.
NEXT_YEAR_PRICENUMBERCeiling rate for the contract’s next year. Empty when none is published.
NORM_VENDOR_NAMETEXTCivly’s normalized vendor name, for matching. Same rule as FORECASTS.NORM_INCUMBENT_NAME.
RATE_IDNUMBERCALC+’s id for the rate.
SCHEDULETEXTGSA schedule. MAS (Multiple Award Schedule) on every row as of October 5, 2026.
SECOND_YEAR_PRICENUMBERCeiling rate for the year after next. Empty when none is published.
SECURITY_CLEARANCEBOOLEANWhether the labor category requires a security clearance.
SINTEXTSpecial Item Number: the part of the schedule the rate is offered under.
SUBCATEGORYTEXTSchedule subcategory, as published.
VENDOR_NAMETEXTContractor name, as published.
WORKSITETEXTWhere the work is done, in the vendor’s wording (the contractor’s site, the customer’s, or both).
SOURCE_URLTEXTThe CALC+ address the rates were read from.
SOURCE_SHA256TEXTChecksum of the file read.
SOURCE_RELEASE_DATEDATEDate of the read.
IMPORTED_ATTIMESTAMP_NTZWhen Civly imported the row.
Schema

Data dictionary: FEDERAL_BUYING_SIGNALS.SUBAWARDS

One row per reported federal subcontract or subgrant, including revised reports, from USASpending.gov. 54 columns. The free trial returns fiscal 2016 only. PRIME_AWARDEE_UEI and SUBAWARDEE_UEI identify the two recipients.

ColumnTypeDescription
PRIME_AWARD_UNIQUE_KEYVARCHARUSASpending's key for the prime award this subaward sits under.
PRIME_AWARD_PIIDVARCHARThe prime contract's award number (PIID). Empty for grants.
PRIME_AWARD_NAICS_CODEVARCHARIndustry code (NAICS) on the prime award.
PRIME_AWARD_NAICS_DESCRIPTIONVARCHARThe prime award's industry code in words.
PRIME_AWARD_FAINVARCHARThe prime grant's award number (FAIN). Empty for contracts.
PRIME_AWARD_CFDA_NUMBERS_AND_TITLESVARCHARFederal assistance program numbers and titles on the prime grant.
PRIME_AWARD_AMOUNTNUMBERTotal amount of the prime award, dollars.
PRIME_AWARD_AWARDING_AGENCY_CODEVARCHARCode of the agency that awarded the prime award.
PRIME_AWARD_AWARDING_AGENCY_NAMEVARCHARAgency that awarded the prime award.
PRIME_AWARD_AWARDING_SUB_AGENCY_CODEVARCHARCode of the awarding sub-agency or component.
PRIME_AWARD_AWARDING_SUB_AGENCY_NAMEVARCHARAwarding sub-agency or component.
PRIME_AWARD_FUNDING_AGENCY_CODEVARCHARCode of the agency that funded the prime award.
PRIME_AWARD_FUNDING_AGENCY_NAMEVARCHARAgency that funded the prime award.
PRIME_AWARDEE_UEIVARCHARThe prime recipient's Unique Entity ID (SAM).
PRIME_AWARDEE_DUNSVARCHARThe prime recipient's legacy DUNS number, as reported.
PRIME_AWARDEE_NAMEVARCHARPrime recipient name.
PRIME_AWARDEE_DBA_NAMEVARCHARPrime recipient's doing-business-as name.
PRIME_AWARDEE_PARENT_UEIVARCHARUEI of the prime recipient's parent company.
PRIME_AWARDEE_PARENT_NAMEVARCHARPrime recipient's parent company.
PRIME_AWARDEE_STATE_CODEVARCHARPrime recipient's state.
PRIME_AWARD_BASE_TRANSACTION_DESCRIPTIONVARCHARThe prime award's description, as published.
SUBAWARD_TYPEVARCHARsub-contract or sub-grant, as reported.
SUBAWARD_SAM_REPORT_IDVARCHARThe subaward report's id in SAM/FSRS. Re-reports share the subaward; IS_LATEST_REPORT marks the newest.
SUBAWARD_NUMBERVARCHARThe prime recipient's own number for this subaward.
SUBAWARD_AMOUNTNUMBERSubaward amount, dollars. Rows with AMOUNT_SUSPECT true carry amounts that fail Civly's sanity checks.
SUBAWARD_ACTION_DATEDATEDate the subaward was signed or last changed.
SUBAWARD_ACTION_DATE_FISCAL_YEARNUMBERFederal fiscal year of the action date.
SUBAWARDEE_UEIVARCHARThe subcontractor's or subrecipient's Unique Entity ID (SAM).
SUBAWARDEE_DUNSVARCHARThe subrecipient's legacy DUNS number, as reported.
SUBAWARDEE_NAMEVARCHARSubcontractor or subrecipient name.
SUBAWARDEE_DBA_NAMEVARCHARSubrecipient's doing-business-as name.
SUBAWARDEE_PARENT_UEIVARCHARUEI of the subrecipient's parent company.
SUBAWARDEE_PARENT_NAMEVARCHARSubrecipient's parent company.
SUBAWARDEE_ADDRESS_LINE_1VARCHARSubrecipient street address, as reported.
SUBAWARDEE_CITY_NAMEVARCHARSubrecipient city.
SUBAWARDEE_STATE_CODEVARCHARSubrecipient state.
SUBAWARDEE_ZIP_CODEVARCHARSubrecipient ZIP code.
SUBAWARDEE_COUNTRY_CODEVARCHARSubrecipient country code.
SUBAWARD_PRIMARY_PLACE_OF_PERFORMANCE_CITY_NAMEVARCHARCity where the subaward work is mainly performed.
SUBAWARD_PRIMARY_PLACE_OF_PERFORMANCE_STATE_CODEVARCHARState where the subaward work is mainly performed.
SUBAWARD_DESCRIPTIONVARCHARWhat the subaward is for, as reported.
USASPENDING_PERMALINKVARCHARLink to the prime award on USASpending.gov.
SUBAWARD_SAM_REPORT_LAST_MODIFIED_DATETIMESTAMP_NTZWhen this subaward report was last changed in SAM/FSRS.
SUBAWARDEE_BUSINESS_TYPESVARCHARThe subrecipient's SAM business-type flags, as published.
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_1_NAMEVARCHARName of highly compensated officer 1, published under the federal executive-compensation disclosure.
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_2_NAMEVARCHARName of highly compensated officer 2, published under the federal executive-compensation disclosure.
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_3_NAMEVARCHARName of highly compensated officer 3, published under the federal executive-compensation disclosure.
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_4_NAMEVARCHARName of highly compensated officer 4, published under the federal executive-compensation disclosure.
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_5_NAMEVARCHARName of highly compensated officer 5, published under the federal executive-compensation disclosure.
KINDVARCHARCivly classification: subcontract or subgrant.
FISCAL_YEARNUMBERFederal fiscal year of the file this row ships in. The trial returns 2016 only.
IS_LATEST_REPORTBOOLEANCivly-derived: true on the newest report of a subaward. Amounts should count latest reports only.
AMOUNT_SUSPECTBOOLEANCivly-derived: true when the published amount fails sanity checks (see AMOUNT_SUSPECT_REASON).
AMOUNT_SUSPECT_REASONVARCHARWhy Civly flagged the amount, when AMOUNT_SUSPECT is true.
Schema

Data dictionary: STATE_CONTRACT_AWARDS

One row per contract, purchase order or award from seven sources in the District of Columbia and five states, mapped by Civly into one set of columns. A column a source does not publish is empty. Only current rows ship. 29 columns. The free trial returns the Delaware, Nevada and Louisiana rows.

ColumnTypeMeaning
IDNUMBERCivly row id.
STATETEXTState or district the source covers: DC, DE, VA, NM, NV or LA.
SOURCETEXTCivly source key: dc_contracts, dc_purchase_orders, de_contracts, va_eva, nm_sunshine_purchases, nv_nevadaepro_contracts or la_checkbook_contracts. The trial returns de_contracts, nv_nevadaepro_contracts and la_checkbook_contracts.
SOURCE_DATASET_IDTEXTThe source’s own dataset or file id.
IS_CURRENTBOOLEANRow is in the source’s latest file. Only current rows ship.
RECIPIENT_NAMETEXTVendor or recipient as the source publishes it.
NORM_RECIPIENT_NAMETEXTCivly-normalized vendor name for matching.
RECIPIENT_CITYTEXTVendor city, where published.
RECIPIENT_STATETEXTVendor state, where published.
RECIPIENT_ZIPTEXTVendor ZIP code, where published.
RECIPIENT_ADDRESSTEXTVendor street address, where published.
AWARDING_AGENCYTEXTAgency that made the award.
AWARDING_DEPTTEXTDepartment or division, where published.
AWARDING_AGENCY_CODETEXTAgency code, where published.
AWARD_IDTEXTContract, purchase order or award number as published.
AWARD_DESCRIPTIONTEXTDescription of the goods or services, as published.
AWARD_TYPETEXTAward or procurement type, where published.
AMOUNTNUMBERDollar amount as published. See AMOUNT_KIND: sources publish contract values, purchase order totals or payments.
AMOUNT_KINDTEXTWhat AMOUNT measures for this source: award_max, the contract value (District of Columbia contracts, Louisiana); po_total, the purchase order amount (District of Columbia purchase orders, Virginia, New Mexico); or spent_to_date, spending under the contract so far (Delaware, Nevada).
AWARD_DATEDATEAward or order date.
START_DATEDATEContract start date, where published.
END_DATEDATEContract end date, where published.
FISCAL_YEARNUMBERFiscal year, where published.
CATEGORY_CODETEXTCommodity or category code, where published.
CATEGORY_DESCTEXTCommodity or category description.
CATEGORY_SYSTEMTEXTCode system of CATEGORY_CODE, for example NIGP or UNSPSC.
NAICS_CODETEXTNAICS industry code, where published.
CREATED_ATTIMESTAMP_NTZWhen Civly first stored the row.
UPDATED_ATTIMESTAMP_NTZWhen Civly last updated the row.
Schema

Data dictionary: NYC_DOING_BUSINESS_ORGANIZATIONS

One row per organization New York City lists as doing business with it, from NYC Doing Business (Mayor’s Office of Contract Services). The city publishes no organization id, so people join to organizations on ORGANIZATION_NAME only. 10 columns. This table returns no rows during the free trial.

ColumnTypeMeaning
SOURCE_ROW_NUMBERNUMBERPosition of the row in the city’s file.
ORGANIZATION_NAMETEXTOrganization doing business with New York City.
OWNERSHIP_STRUCTURE_CODETEXTOwnership structure code as the city publishes it.
ORGANIZATION_PHONETEXTOrganization phone number as published.
SOURCE_ROW_IDTEXTThe city’s row id.
DOING_BUSINESS_START_DATE_AS_PUBLISHEDTEXTStart date exactly as the city publishes it.
DOING_BUSINESS_START_DATEDATEStart date read as a date (two-digit years read as 20YY).
SOURCE_URLTEXTAddress of the city’s file.
SOURCE_RELEASE_DATEDATERelease date of the city’s file, when given.
IMPORTED_ATTIMESTAMP_NTZWhen Civly imported the row.
Schema

Data dictionary: NYC_DOING_BUSINESS_PEOPLE

Principals of organizations doing business with New York City, from NYC Doing Business (Mayor’s Office of Contract Services). Names and roles only. Join to NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME. 16 columns. This table returns no rows during the free trial.

ColumnTypeMeaning
SOURCE_ROW_NUMBERNUMBERPosition of the row in the city’s file.
MOCS_PEOPLE_IDTEXTThe Mayor’s Office of Contract Services id for the person.
ORGANIZATION_NAMETEXTOrganization the person is a principal of.
PERSON_FIRST_NAMETEXTFirst name.
PERSON_MIDDLE_NAMETEXTMiddle name.
PERSON_LAST_NAMETEXTLast name.
PERSON_NAME_SUFFIXTEXTName suffix.
RELATIONSHIP_TYPE_CODETEXTThe person’s role at the organization, as coded by the city.
SOURCE_ROW_IDTEXTThe city’s row id.
DOING_BUSINESS_START_DATE_AS_PUBLISHEDTEXTStart date exactly as the city publishes it.
DOING_BUSINESS_START_DATEDATEStart date read as a date.
DOING_BUSINESS_END_DATE_AS_PUBLISHEDTEXTEnd date exactly as the city publishes it.
DOING_BUSINESS_END_DATEDATEEnd date read as a date.
SOURCE_URLTEXTAddress of the city’s file.
SOURCE_RELEASE_DATEDATERelease date of the city’s file, when given.
IMPORTED_ATTIMESTAMP_NTZWhen Civly imported the row.
Matching

Joining the tables

Forecasts and labor rates share no key. NORM_INCUMBENT_NAME in FORECASTS and NORM_VENDOR_NAME in LABOR_RATES are normalized the same way, so a forecast’s incumbent can be matched to that company’s ceiling rates. A forecast that lists several incumbents joins them as a; b, and those rows match only after you split the value. Subawards identify recipients by UEI and legacy DUNS. The forecast and labor-rate tables have no UEI column, so matching a recipient to them requires checking company names or an outside identifier mapping. STATE_CONTRACT_AWARDS and the two NYC Doing Business tables share no id with the federal tables or with each other. Match them by name, using NORM_RECIPIENT_NAME on the state contract side. NYC_DOING_BUSINESS_PEOPLE joins NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME only, because the city publishes no organization id.

Getting started

Sample queries

After installing, set your worksheet’s database selector to the installed database and these run as written.

-- Forecasts listed now with an award planned in the next 12 months, largest bands first
SELECT agency, title, naics_code, set_aside, estimated_value_range, incumbent_name,
       planned_award_window_start, planned_award_window_end
FROM FEDERAL_BUYING_SIGNALS.FORECASTS
WHERE listed_in_latest_feed
  AND planned_award_window_start <= DATEADD(month, 12, CURRENT_DATE)
  AND planned_award_window_end >= CURRENT_DATE
ORDER BY estimated_value_min_usd DESC NULLS LAST
LIMIT 50;

-- Recompetes listed now, by industry code
SELECT naics_code, naics_description, COUNT(*) AS recompetes
FROM FEDERAL_BUYING_SIGNALS.FORECASTS
WHERE listed_in_latest_feed AND requirement_type = 'recompete'
GROUP BY naics_code, naics_description
ORDER BY recompetes DESC
LIMIT 20;

-- Forecasts that left the feeds in the last 30 days
SELECT source, agency, title, last_seen_date, solicitation_url
FROM FEDERAL_BUYING_SIGNALS.FORECASTS
WHERE NOT listed_in_latest_feed AND last_seen_date >= DATEADD(day, -30, CURRENT_DATE)
ORDER BY last_seen_date DESC;

-- Ceiling rates for one kind of job, by business size
SELECT business_size, COUNT(*) AS rates,
       MEDIAN(current_price) AS median_rate,
       APPROX_PERCENTILE(current_price, 0.9) AS rate_90th_percentile
FROM FEDERAL_BUYING_SIGNALS.LABOR_RATES
WHERE category ILIKE '%facilities%' AND labor_category ILIKE '%project manager%'
GROUP BY business_size;

-- Recompetes whose incumbent also holds GSA schedule rates
SELECT f.agency, f.title, f.incumbent_name, f.planned_award_window_start,
       COUNT(r.rate_id) AS incumbent_rates, MEDIAN(r.current_price) AS median_ceiling_rate
FROM FEDERAL_BUYING_SIGNALS.FORECASTS f
JOIN FEDERAL_BUYING_SIGNALS.LABOR_RATES r ON r.norm_vendor_name = f.norm_incumbent_name
WHERE f.listed_in_latest_feed AND f.requirement_type = 'recompete'
GROUP BY f.agency, f.title, f.incumbent_name, f.planned_award_window_start
ORDER BY incumbent_rates DESC
LIMIT 25;

-- Subaward dollars by prime recipient, newest reports with usable amounts only
SELECT PRIME_AWARDEE_UEI, PRIME_AWARDEE_NAME,
       COUNT(*) AS SUBAWARD_REPORTS,
       SUM(SUBAWARD_AMOUNT) AS REPORTED_SUBAWARD_USD
FROM FEDERAL_BUYING_SIGNALS.SUBAWARDS
WHERE IS_LATEST_REPORT = TRUE AND AMOUNT_SUSPECT = FALSE
GROUP BY PRIME_AWARDEE_UEI, PRIME_AWARDEE_NAME
ORDER BY REPORTED_SUBAWARD_USD DESC NULLS LAST
LIMIT 25;

-- Inspect the reasons amounts were flagged before using them
SELECT AMOUNT_SUSPECT_REASON, COUNT(*) AS REPORTS
FROM FEDERAL_BUYING_SIGNALS.SUBAWARDS
WHERE IS_LATEST_REPORT = TRUE AND AMOUNT_SUSPECT = TRUE
GROUP BY AMOUNT_SUSPECT_REASON
ORDER BY REPORTS DESC;
Provenance

Sourcing and attribution

Sources: the DHS Acquisition Planning Forecast System (apfs-cloud.dhs.gov), the GSA Acquisition Gateway forecast tool (acquisitiongateway.gov/forecast) and GSA’s CALC+ ceiling rates (buy.gsa.gov/pricing). USASpending.gov supplies the federal subcontract and subgrant reports. These are U.S. government publications, read from their public pages without signing in. Other agencies publish forecasts only on their own sites or in spreadsheets, and those are not included.

Forecasts exclude named agency contacts. The contact and small-business contact names, email addresses and phone numbers the agencies publish are not loaded. Email addresses typed into descriptions, notes and incumbent names are replaced with [email removed].

State and city contract awards come from seven sources. District of Columbia contracts and purchase orders come from PASS, the District’s procurement system, and are credited to the Office of Contracting and Procurement, District of Columbia, under the Creative Commons Attribution 4.0 license (CC BY 4.0). Virginia eVA procurement data is credited to the Virginia Department of General Services and used under the Open Data Commons Attribution License. Delaware contracts come from data.delaware.gov, which Delaware makes available on an “as is” basis. The New Mexico Sunshine Portal (ssp.nm.gov), Nevada ePro (nevadaepro.com) and Louisiana Checkbook (checkbook.la.gov) supply the other three. Civly has changed the data: it maps every source into one set of columns, and where a source lists one contract or order on several lines, it combines them into one row. Coverage is limited to these seven sources. Other states are not included yet.

The two NYC Doing Business tables come from NYC Open Data and are credited to the Mayor’s Office of Contract Services, NYC Doing Business. Civly’s tables are a derived product. Civly reads the city’s dates as dates, and the city’s own text is kept in the _AS_PUBLISHED columns. SOURCE_RELEASE_DATE gives the version of the city’s file each row came from. The city’s table of campaign contributions matched to these organizations and people is not included. NYC.gov’s terms of use say that NYC.gov and all materials on it are distributed “as is” and “as available.”

Civly’s own columns: REQUIREMENT_TYPE, ESTIMATED_VALUE_MIN_USD, ESTIMATED_VALUE_MAX_USD, PLANNED_AWARD_WINDOW_START, PLANNED_AWARD_WINDOW_END, NORM_INCUMBENT_NAME, NORM_VENDOR_NAME, FIRST_SEEN_DATE, LAST_SEEN_DATE and LISTED_IN_LATEST_FEED, plus subaward columns KIND, FISCAL_YEAR, IS_LATEST_REPORT, AMOUNT_SUSPECT and AMOUNT_SUSPECT_REASON, state contract columns NORM_RECIPIENT_NAME, AMOUNT_KIND and IS_CURRENT, and the NYC Doing Business columns DOING_BUSINESS_START_DATE and DOING_BUSINESS_END_DATE. Everything else is as the agencies publish it, apart from the combined state contract rows described above. This product is not endorsed by DHS, GSA, the District of Columbia, the states of Delaware, Virginia, New Mexico, Nevada or Louisiana, the City of New York, or any other government agency.

Permitted use: not for employment, tenant, credit, insurance or licensing decisions about a person.

For coverage or access questions: matthew@civly.ai