# BigID::DataSource::S3 Manage a BigID S3 data source ## Syntax To declare this entity in your AWS CloudFormation template, use the following syntax: ### JSON
{
    "Type" : "BigID::DataSource::S3",
    "Properties" : {
        "Name" : String,
        "Enabled" : Boolean,
        "FriendlyName" : String,
        "Description" : String,
        "AwsAuthenticationType" : String,
        "AwsRoleSessionName" : String,
        "AwsRoleArn" : String,
        "AwsAccessKey" : String,
        "AwsSecretKey" : String,
        "AwsSessionToken" : String,
        "AwsRegion" : String,
        "BucketName" : String,
        "IncludeExcludeFiles" : Boolean,
        "FileTypesToExclude" : String,
        "FolderToScan" : String,
        "ScannerGroup" : String,
        "TestConnectionTimeoutInSeconds" : Double,
        "CustomFields" : [ CustomField, ... ],
        "BusinessOwners" : [ User, ... ],
        "ItOwners" : [ User, ... ],
        "Location" : String,
        "Scope" : String,
        "SecurityTier" : String,
        "Comments" : String,
        "NumberOfParsingThreads" : String,
        "MetadataAclScanEnabled" : Boolean,
        "DsAclScanEnabled" : Boolean,
        "EnabledOcr" : Boolean,
        "OcrTimeout" : Double,
        "OcrLanguages" : String,
        "EnableClustering" : Boolean,
        "EnableClassifiers" : Boolean,
        "EnableAdvanceClassifiers" : Boolean,
        "SampleFolders" : Boolean,
        "SamplePercentage" : String,
        "SampleFileContent" : Boolean,
        "DifferentialScan" : Boolean,
        "IsModifiedInXDays" : Boolean,
        "XLastDays" : Double,
        "ScanWindowName" : String,
        "ParquetFileRegex" : String
    }
}
### YAML
Type: BigID::DataSource::S3
Properties:
    Name: String
    Enabled: Boolean
    FriendlyName: String
    Description: String
    AwsAuthenticationType: String
    AwsRoleSessionName: String
    AwsRoleArn: String
    AwsAccessKey: String
    AwsSecretKey: String
    AwsSessionToken: String
    AwsRegion: String
    BucketName: String
    IncludeExcludeFiles: Boolean
    FileTypesToExclude: String
    FolderToScan: String
    ScannerGroup: String
    TestConnectionTimeoutInSeconds: Double
    CustomFields: 
      - CustomField
    BusinessOwners: 
      - User
    ItOwners: 
      - User
    Location: String
    Scope: String
    SecurityTier: String
    Comments: String
    NumberOfParsingThreads: String
    MetadataAclScanEnabled: Boolean
    DsAclScanEnabled: Boolean
    EnabledOcr: Boolean
    OcrTimeout: Double
    OcrLanguages: String
    EnableClustering: Boolean
    EnableClassifiers: Boolean
    EnableAdvanceClassifiers: Boolean
    SampleFolders: Boolean
    SamplePercentage: String
    SampleFileContent: Boolean
    DifferentialScan: Boolean
    IsModifiedInXDays: Boolean
    XLastDays: Double
    ScanWindowName: String
    ParquetFileRegex: String
## Properties #### Name Type data source name. _Required_: Yes _Type_: String _Pattern_: ^[\w\-\s\(\):]+$ _Update requires_: [Replacement](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-replacement) #### Enabled _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### FriendlyName Type data source friendly Name _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### Description Add a short description (optional) _Required_: No _Type_: String _Maximum_: 100 _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsAuthenticationType AWS Authentication Type _Required_: No _Type_: String _Allowed Values_: isCredentialsAuth | isIamRoleAuth | isAnonymousAuth | isCrossAccountAuth | isSTSAuth _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsRoleSessionName Aws Role Session Name. Leave blank for default (only used when the "AwsAuthenticationType" is set to "isCrossAccountAuth") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsRoleArn Aws Role Arn (only used when the "AwsAuthenticationType" is set to "isCrossAccountAuth") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsAccessKey AWS Access Key (only used when the "AwsAuthenticationType" is set to "isSTSAuth" or "isCredentialsAuth") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsSecretKey AWS Secret Key (only used when the "AwsAuthenticationType" is set to "isSTSAuth" or "isCredentialsAuth") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsSessionToken AWS Session Token (only used when the "AwsAuthenticationType" is set to "isSTSAuth") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### AwsRegion AWS Region. Example: us-west-2. If empty, search buckets in all regions _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### BucketName Bucket name _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### IncludeExcludeFiles _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### FileTypesToExclude File Type(s). Example: type1,type2,type3 _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### FolderToScan Folder to Scan _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### ScannerGroup This data source will be scanned only by scanner instances that are included under this Scanner Group. Used primarily when remote scans are configured. _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### TestConnectionTimeoutInSeconds Test Connection Timeout _Required_: No _Type_: Double _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### CustomFields Custom Parameters _Required_: No _Type_: List of CustomField _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### BusinessOwners _Required_: No _Type_: List of User _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### ItOwners _Required_: No _Type_: List of User _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### Location Select the country, state, province or territory where the Data Source is located. _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### Scope _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### SecurityTier Security Tier _Required_: No _Type_: String _Allowed Values_: 1 | 2 | 3 | 4 | 5 _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### Comments _Required_: No _Type_: String _Minimum_: 1 _Maximum_: 150 _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### NumberOfParsingThreads Number of Threads _Required_: No _Type_: String _Pattern_: ^[0-9]*$ _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### MetadataAclScanEnabled Will enable ACL for both Data Source and enumdata scans _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### DsAclScanEnabled Will enable ACL for both Data Source and Metadata scans _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### EnabledOcr _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### OcrTimeout OCR Timeout in Seconds (only used when "EnabledOcr" is set to "true") _Required_: No _Type_: Double _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### OcrLanguages OCR Languages (only used when "EnabledOcr" is set to "true") _Required_: No _Type_: String _Allowed Values_: eng | chi_sim+chi_tra | ind | jpn | kor | tha | vie | deu | fra | bul _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### EnableClustering _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### EnableClassifiers _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### EnableAdvanceClassifiers _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### SampleFolders Sample Files within Folders _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### SamplePercentage Sample Percentage. Example: 20, for scanning 20% of the folder (used only when "SampleFolders" is set to "true") _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### SampleFileContent Sample File Content _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### DifferentialScan For structured data sources, new objects or objects with structural changes (e.g., new columns) will be scanned. _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### IsModifiedInXDays Used only when "DifferentialScan" is set to "true" _Required_: No _Type_: Boolean _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### XLastDays Used only when "DifferentialScan" and "IsModifiedInXDays" is set to "true" _Required_: No _Type_: Double _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### ScanWindowName Scannable Window _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) #### ParquetFileRegex Parquet File Regex. (Use regex to identify which parquet files will be scanned.) _Required_: No _Type_: String _Update requires_: [No interruption](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/using-cfn-updating-stacks-update-behaviors.html#update-no-interrupt) ## Return Values ### Ref When you pass the logical ID of this resource to the intrinsic `Ref` function, Ref returns the Name.