If you’re new to Unstructured, read this note first.Before you can create a source connector, you must first sign up for Unstructured and get your Unstructured API key. After you sign up, the Unstructured user interface (UI) appears, which you use to get the key. To learn how, watch this 40-second how-to video.After you create the source connector, add it along with a destination connector to a workflow. Then run the worklow as a job. To learn how, try out the hands-on Workflow Endpoint quickstart, go directly to the quickstart notebook, or watch the two 4-minute video tutorials for the Unstructured Python SDK.You can also create source connectors with the Unstructured user interface (UI). Learn how.If you need help, reach out to the community on Slack, or contact us directly.You are now ready to start creating a source connector! Keep reading to learn how.
Ingest your files into Unstructured from SharePoint. The requirements are as follows.
If you are setting up the SharePoint connector for the first time, you can skip past this note.Previous versions of the SharePoint connector relied on SharePoint app principals for authentication. Current versions of the SharePoint connector no longer support these SharePoint app principals. Microsoft deprecated support for Share Point app principals on November 27, 2023. SharePoint app principals will no longer work for SharePoint tenants that were created on or after November 1, 2024, and they will stop working for all SharePoint tenants as of April 2, 2026. Learn more.Current versions of the SharePoint connector now rely on Microsoft Entra ID app registrations for authentication.To migrate from SharePoint app princpals to Entra ID app regisrations, replace the following settings in your existing SharePoint connector, as listed in the requirements following this note:
  • Replace the deprecated SharePoint app principal’s application client ID value with your replacement Entra ID app registration’s Application (client) ID value.
  • Replace the deprecated SharePoint app principal’s client secret value with your replacement Entra ID app registration’s Client secret value.
  • Add your replacement Entra ID app registration’s Directory (tenant) ID value, token authority URL value, and the correct set of Microsoft Graph access permissions for SharePoint Online.
If you need migration help, get assistance from our Slack community or contact us directly.
  • A SharePoint Online plan, or a Microsoft 365 or Office 365 Business or enterprise plan that includes SharePoint Online. Learn more. Shop for business plans. Shop for enterprise plans.
  • A OneDrive for business plan, or a Microsoft 365 or Office 365 Business or enterprise plan that includes OneDrive. (Even if you only plan to use SharePoint Online, you still need a plan that includes OneDrive, because the SharePoint connector is built on OneDrive technology.) Learn more. Shop for business plans. Shop for enterprise plans. OneDrive personal accounts, and Microsoft 365 Free, Basic, Personal, and Family plans are not supported.
  • The SharePoint Online and OneDrive plans must share the same Microsoft Entra ID tenant. Learn more.
  • The User Principal Name (UPN) for the OneDrive account in the Microsoft Entra ID tenant. This is typically the OneDrive account user’s email address. To find a UPN:
    1. Depending on your plan, sign in to your Microsoft 365 admin center (typically https://admin.microsoft.com) using your administrator credentials, or sign in to your Office 365 portal (typically https://portal.office.com) using your credentials.
    2. In the Users section, click Active users.
    3. Locate the user account in the list of active users.
    4. The UPN is displayed in the Username column.
    The following video shows how to get a UPN:
  • The SharePoint Online site URL.
    • Site collection-level URLs typically have the format https://<tenant>.sharepoint.com/sites/<site-collection-name>.
    • Root site collection-level URLs typically have the format https://<tenant>.sharepoint.com.
    • To process all sites within a SharePoint tenant, use a site URL of https://<tenant>-admin.sharepoint.com.
    Learn more.
  • The path in the SharePoint Online site from which to start parsing files, for example "Shared Documents". If the SharePoint connector is to process all sites within the tenant, this filter will be applied to all site document libraries. The following video shows how to get the site URL and a path within the site:
  • The Application (client) ID, Directory (tenant) ID, and Client secret for the Microsoft Entra ID app registration with the correct set of Microsoft Graph access permissions. These permissions include:
    • Sites.ReadWrite.All (if both reading and writing are needed)
    • User.Read.All Learn more.
    1. Create an Entra ID app registration.
    2. Add Graph access permissions to an app registration.
    3. Grant consent for the added Graph permissions.
    The following video shows how to create an Entra ID app registration: The following video shows how to add the correct set of Graph access permissions to the Entra ID app registration:
  • The token authority URL for your Microsoft Entra ID app registration. This is typically https://login.microsoftonline.com
To create a SharePoint source connector, see the following examples. 
import os

from unstructured_client import UnstructuredClient
from unstructured_client.models.operations import CreateSourceRequest
from unstructured_client.models.shared import (
    CreateSourceConnector,
    SourceConnectorType,
    SharePointSourceConnectorConfigInput
)

with UnstructuredClient(api_key_auth=os.getenv("UNSTRUCTURED_API_KEY")) as client:
    response = client.sources.create_source(
        request=CreateSourceRequest(
            create_source_connector=CreateSourceConnector(
                name="<name>",
                type=SourceConnectorType.SHAREPOINT,
                config=SharePointSourceConnectorConfigInput(
                    client_id="<client_id>",
                    site="<site>",
                    tenant="<tenant>",
                    authority_url="<authority_url>",
                    user_pname="<user_pname>",
                    client_cred="<client_cred>",
                    path="<path>",
                    recursive=<True|False>
                )
            )
        )
    )

    print(response.source_connector_information)
Replace the preceding placeholders as follows:
  • <name> (required) - A unique name for this connector.
  • <client-id> (required) - The client ID provided by SharePoint for the app registration.
  • <site> (required) - The base URL of the SharePoint site to connect to.
  • <tenant> (_required) - The Directory (tenant) ID for the Microsoft Entra ID app registration with the correct set of Microsoft Graph access permissions.
  • <authority-url> - The authentication token provider URL for the Entra ID app registration. The default is https://login.microsoftonline.com.
  • <user-pname> (required) - The UPN for the OneDrive account in the Entra ID tenant.
  • <client-cred> (required) - The Client secret for the Entra ID app registration.
  • <path> - The path from which to start parsing files. The default is Shared Documents if not otherwise specified.
  • For recursive, set to true to recursively process data from subfolders within the specified path. The default is false if not otherwise specified.