Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: typo
HTML Wrap
width250
alignright
classmenu
Page properties
Connector PackDAM Connector Pack
License

Include Page
_MLA
_MLA

IssuesEXTDAM
Maven siteexternal-dam
Latest version

Artifact resource link
groupIdinfo.magnolia.external.dam
artifactIdmagnolia-external-dam
label$version
renderTypedisplay_only
resourceTypePOM

HTML Wrap
clearboth
width250
alignright
classmenu

Related topics:

The DAM Connector Pack modules allow you to connect to your external DAM and make your existing assets, including videos, PDFs and images, available directly within Magnolia. 

Table of Contents
maxLevel4

Module structure

artifactIDDescription

magnolia-external-dam-parent

Parent reactor.

magnolia-external-dam

Provides the foundation for integrating with S3 and Bynder and a sample component for using assets in the Pages app.

magnolia-external-dam-bynder

Provides a default implementation to connect to Bynder.

magnolia-external-dam-s3

Provides a default implementation to connect to Amazon S3.

Installing

Maven is the easiest way to install the modules. Add the following dependencies to your webapp. All the other necessary dependencies will be brought in automatically:

Multiexcerpt
MultiExcerptNameInstall

Artifact maven dependencies snippet
groupIdinfo.magnolia.external.dam
artifactIdmagnolia-external-dam
version

Artifact maven dependencies snippet
groupIdinfo.magnolia.external.dam
artifactIdmagnolia-external-dam-bynder
version

Artifact maven dependencies snippet
groupIdinfo.magnolia.external.dam
artifactIdmagnolia-external-dam-s3
version

Configuration

This section explains how to configure the connection between the External DAM module and your external asset management solution. Essentially, you:

  • Provide connection credentials for your external solution.
  • Configure the cache if necessary.

You can create or edit the configuration in the JCR or the File System (YAML) under <module-name>/external-dams/<definition-name>.

Before you configure the connection, make sure you know:

  • Which solution you want to connect to. Default implementations are provided for:
    • AWS S3
    • Bynder
  • Connection credentials for your solution.
Info

If you want to connect to another third-party tool, extend the Magnolia DAM API and create your own asset provider.

AWS S3 connection configuration

To use AWS S3 assets in Magnolia, you must have a working AWS account.

Credentials

You need AWS S3 credentials to connect your S3 buckets and display their content in Magnolia. Credentials consist of two parts: 

  • AWS access key ID
  • AWS secret access key

Add these credentials to your Magnolia instance in the Password manager app. For example:

Mgnl f
aws-credentials



aws_access_key_id


aws_secret_access_key



Info

The  magnolia-aws-foundation module handles all Amazon connections from Magnolia.  This module is installed automatically by Maven when you install the External DAM module.

Configuring an AWS S3 bucket whitelist

By default, all the buckets in the S3 account you connect to are displayed. If you do not want to display all your buckets, you can configure a whitelist under /dam-s3/config.yaml using regex.

For example:

Code Block
whitelistedBuckets:
- "^a.*"
- a-particular-bucket

Bynder connection configuration

To use Bynder assets in Magnolia, you must have a working Bynder account.

API token

You need a permanent OAuth 2.0 API token from Bynder to access the assets.

To generate a token, see this Bynder documentation: https://help.bynder.com/system/oauth2-permanent-tokens.htm

You can use the token value directly in the yaml configuration or add the permanent token to your Magnolia instance in the Password manager app and reference the path in the configuration. For example:

Mgnl f
 bynder-credentials



 bynder_permanent_token

Connecting

Add your connection configuration under /dam-bynder/config.yaml.

Code Block
languageyml
bynderPortalURL: https://magnoliaintegration.getbynder.com
permanentToken: <client_secret_or_path_to_password_manager>
Connection properties
PropertyDescription
bynderPortalURL

required

URL to your Bynder service.

permanentToken

required

A permanent OAuth 2.0 API token from Bynder or the path to the Passwords app where the token is stored. 

Configuring the cache

This connector pack uses Caffeine, a high-performance Java cache library, to manage caching for external assets via a Magnolia helper module called magnolia-addon-commons-cache.

For Bynder and S3 caching, you can specify the behavior of the caches. Essentially, you can configure all the parameters available in CaffeineSpec. For example:

  • Set a maximum cache size.
  • Define how often the cache expires.

Additionally, you can:

  • Enable or disable the cache. 

You configure caching through decoration under /<dam-connector>/decorations/addon-commons-cache/config.yaml.

Bynder default configuration

Code Block
languageyml
title/dam-bynder/decorations/addon-commons-cache/config.yaml
cacheConfigurations:
  bynder:
    caches:
      bynder-media: maximumSize=500, expireAfterAccess=10m
      bynder-all: expireAfterAccess=60m
      bynder-size: expireAfterAccess=60m
    enabled: true

S3 default configuration

Code Block
languageyml
title/dam-s3/decorations/addon-commons-cache/config.yaml
cacheConfigurations:
  s3:
    caches:
      s3-objects: maximumSize=500, expireAfterAccess=10m
      s3-buckets: expireAfterAccess=60m
      s3-count: maximumSize=500, expireAfterAccess=10m
      s3-pages: maximumSize=500, expireAfterAccess=10m
Cache configuration properties
PropertyDescription

caches

required

Use CaffeineSpec properties to specify the cache behavior such as the maximum size of the cache and when cache entries expire for each cache.

For example:

<cacheName-1>: maximumSize=500, expireAfterAccess=10m

<cacheName-2>: expireAfterAccess=60m

enabled

required, true by default

Set to false to disable caching.

Note
titleBynder loading times

Note that the Bynder API may be very slow in some regions. For example, one image upload may take up to 20 seconds in EU regions. This may cause some actions to fail in the Magnolia UI and the cache to be invalidated.

For more information, see https://github.com/Bynder/bynder-js-sdk/issues/43.

Manually flushing the cache

If you want to flush the cache, you can either set the cache expiry to a very short time (see above) or configure a script in the Groovy app to flush the cache manually. For example:

Code Block
languagegroovy
import info.magnolia.objectfactory.Components
 
cacheManager = Components.getComponent(info.magnolia.addon.commons.cache.CacheManager)
cacheManager.evictCache("s3-objects")

Configuring the maximum search time for S3

You can configure the maximum time the system spends searching for S3 assets to be displayed in the Magnolia interface.

Code Block
languageyml
titledam-s3/config.yaml
maxSearchTimeInMilis: 10000

maxSearchTimeInMilis

optional

The maximum time the system spends searching for S3 assets. By default, the maximum search time is 10 seconds.

For example: maxSearchTimeInMilis: 10000

Hide block

Configuring pagination to improve response times

Magnolia retrieves pages of objects from Amazon S3 and Bynder and then obtains the assets you require from those pages. The pages are cached.

You can configure the size of a page of objects using the property pageSize.

Bynder has an additional property you can use if you set the page size to more than 1000 objects. 

Code Block
languageyml
titledam- <s3/Bynder> /config.yaml
pageSize: 100
pageSize

optional

The maximum number of objects per request retrieved from your external system.

  • S3 default: 1000 
  • Bynder default: 100

(warning) For S3, the minimum value possible is 100.

bynderMaxNumberPerRequest

optional, default is 1000 (Bynder only)

Maximum number of objects that Bynder returns if you specify a pageSize greater than 1000.

See the Bynder documentation: https://bynder.docs.apiary.io/#reference/oauth-1.0a/retrieve-assets, limit parameter.

Usage

The  magnolia-external-dam submodule provides a sample Text and external image page component so that editors and marketers can select and use external assets in the Pages app. See DAM Connector Pack for an example.

Release history

Multiexcerpt
MultiExcerptNamedamconnectorpackrelease
Hide block

External DAM module 1.0.3

Released on December XX, 2020.

This release brings a number of improvements and bug fixes

Bynder SDK 2.2.1

The Bynder STK SDK version has been reverted from 2.2.4 to 2.2.1.

This resolves the issue discovered in version External DAM 1.03 that blocks users from uploading assets to Bynder via Magnolia. 

Jira
serverMagnolia - Issue tracker
serverId500b06a6-e204-3125-b989-2d75b973d05f
keyEXTDAM-198

Configuring pagination  

You can now configure pagination to improve response times.

Jira
serverMagnolia - Issue tracker
serverId500b06a6-e204-3125-b989-2d75b973d05f
keyEXTDAM-169


External DAM module 1.0.2

Released on November 18, 2020.

This release brings compatibility for Magnolia 6.2.4 and a number of improvements and bug fixes.

Note

We have discovered an issue with Bynder STK SDK version 2.2.4 and External DAM 1.0.2 that blocks users from uploading assets to Bynder via Magnolia. 

Do not use this release if you are a Bynder connector user. External DAM 1.0.3 corrects the issue and will be released soon. 

Improved handling of large numbers of S3 assets

Magnolia has improved how large numbers (thousands) of assets in a given S3 folder are rendered. 

Magnolia has a specialized method that counts the total number of assets in your S3 system instead of creating the corresponding internal objects. Since S3 only allows batches of 1000 assets to be retrieved in a given call, we iterate as many API calls as necessary to retrieve the assets stored in S3.

For example, Magnolia must make 100 API calls to retrieve 100 000 assets. Depending on your internet bandwidth, cache and other factors, this could take around 1 minute to complete. For better response times, we recommend that you store a maximum of 10 000 assets per S3 bucket.

EXTDAM-170EXTDAM-138

Configure the maximum search time for S3

You can configure the maximum time the system spends searching for S3 assets to be displayed in the Magnolia interface using a new parameter called maxSearchTimeInMilis under dam-s3/config.yaml.

By default, the maximum search time is 10 seconds (maxSearchTimeInMilis: 10000).

EXTDAM-184

Mime types

If you upload an asset that does not have a suffix, Magnolia now infers the mime type from the binary.

To avoid extra API calls to S3, we recommend you include the suffix whenever possible.

EXTDAM-126

Bug fixes

External DAM module 1.0.1

Released on June 22nd, 2020.

This release brings compatibility for Magnolia 6.2.1 and a number of minor improvements and bug fixes:

  • [EXTDAM-105] - (Bynder) Allow upload another image when editing
  • [EXTDAM-106] - (Bynder) Set the asset's name with the name of the upload file
  • [EXTDAM-121 ] - Cache is not applied when browsing through app-chooser
  • [EXTDAM-119] - Adjust to Periscope changes in 6.2.1
  • [EXTDAM-104] - Show notification to the user when an async action started
  • [EXTDAM-108] - (Bynder) Correct notify message with apostrophe
  • [EXTDAM-112] - (Bynder) Edit asset fails with exception
  • [EXTDAM-113] - (Bynder) Changing the image is not reflected in the tree unless the name is updated
  • [EXTDAM-114] - Periscope search is case sensitive
  • [EXTDAM-115] - (S3) Double click on bucket or folder opens the editor
  • [EXTDAM-116] - (S3) Strange behaviour deleting a folder
  • [EXTDAM-120] - (Bynder) The item deletion does not happen immediately

External DAM module 1.0

Released on April 6, 2020.

Initial release of the DAM Connector Pack for integrating with Bynder and Amazon S3, so that you can use your assets directly in Magnolia. 

See DAM Connector Pack for an overview of the functionality provided.

DAM Connector Pack compatibility

Module versionMagnolia CMS version
1.0.26.2.4
1.0.16.2.1

1.0

6.2


Include Page
_connector compatibility note
_connector compatibility note

Module versionBynder SDK
1.0.22.2.4
1.0Tested against 2.2.0
Module versionAWS Java SDK
1.0.1 2.13.25
1.0Tested against 2.9.7