{"id":782,"date":"2016-07-26T15:39:39","date_gmt":"2016-07-26T14:39:39","guid":{"rendered":"https:\/\/digitalactionplan.com\/?p=782"},"modified":"2020-06-01T14:30:36","modified_gmt":"2020-06-01T13:30:36","slug":"how-we-evaluate-dap","status":"publish","type":"post","link":"https:\/\/helpfuldigital.com\/fr\/how-we-evaluate-dap\/","title":{"rendered":"How do we evaluate learning new skills and growing confidence?"},"content":{"rendered":"

We’re often asked: how do you evaluate the Digital Action Plan?<\/p>\n

Quite rightly, clients\u00a0want to know their learning budget is being put to good use.<\/p>\n

We don’t (yet) have a fancy evaluation framework, or a standard way of scoring people. This is because:<\/p>\n

    \n
  1. this programme is about confidence as much as skills. Confidence is very difficult to measure in a meaningful, objective\u00a0way, especially in the\u00a0work environment. Confident-sounding participants often have as much to learn as those who consider themselves least confident, but who might be doing great things online, unrecognised.<\/li>\n
  2. the needs of individuals, and the requirements of the\u00a0teams they work in, varies so much between sectors. Benchmarks become meaningless. We want participants\u00a0to put their audiences, customers and colleagues first, rather than use channels or techniques simply because there are some ‘accepted’ industry standards.<\/li>\n<\/ol>\n

    However, there are a variety of actions and data points that we can capture. Taken together help to\u00a0determine whether or not a participant has learned something new and\u00a0feels more confident.<\/p>\n

    1. Have participants told us they learned something or feel more confident?<\/h2>\n

    In a workshop, over the phone, on email or in the forum, participants tell us what they’ve done, what they don’t get and what they think of their plan.<\/p>\n

    We don’t always share this feedback verbatim with clients. It’s fundamental to building confidence that participants\u00a0trust us,\u00a0and we rely on participants being honest with us about what they don’t know.<\/p>\n

    However we do capture and share feedback internally with the team here, so that we can help someone if we’re in the early stages of their plan, or hopefully celebrate their learning if they have fed back on something they’ve tested.<\/p>\n

    We’ll present this at the end of the programme as quotes (usually anonymised) grouped by theme.<\/p>\n

    2. What have participants achieved within their plan?<\/h2>\n

    We can measure how much of a\u00a0plan someone has said they have read, and completed. This programme relies on trust and for the most part this works well. Wherever possible we’ll try to find evidence of practice (see Commitment, below) to back this up.<\/p>\n

    However, we’ve taken a conscious decision not to test people and demand evidence. We’re not authorised to dictate how people allot their working time. Our starting point is that motivated, curious staff will make time to read, experiment and practice the things they feel are relevant to them.<\/p>\n

    So, if someone says they read and completed a task, we believe them and we’ll count that as progress.<\/p>\n

    This data is available throughout the programme and we’ll present a read out of completion percentages at the end.<\/p>\n

    3. How much effort has a participant put in?<\/h2>\n

    Digital Action Plans are personal to each\u00a0participant and within any given cohort most of these will look different. That’s because when you peel back the lid on digital skills and confidence, even the most accomplished teams bear huge disparities.<\/p>\n

    For this reason, measuring everyone on reading and completion rates (above) isn’t fair. We were a bit harsh on one participant who had only ticked\u00a0a few goals, before realising that she had put maximum effort in to the goals she had completed. This is the difference between someone who barely uses the internet outside of work joining a social media channel, and an accomplished Head of Digital Something being a bit better at planning.<\/p>\n

    We’ll present this at the end of the programme as a\u00a0brief personal assessment, based on the exchanges we\u00a0have\u00a0and observations we’ve made.<\/p>\n

    4. What have participants put in to practice?<\/h2>\n

    This gets to the core purpose of the Digital Action Plan.<\/p>\n

    For us, this is the most rewarding and valuable progress that we look for: evidence of people doing things differently. This might include trying new channels, changing websites or internal processes based on data they are capturing, blogging openly about their work or testing and iterating content.<\/p>\n

    In this we’ll also include the contributions they make to their cohort’s forum on the Digital Action Plan platform.<\/p>\n

    We encourage people to put what they’re learning in to practice, as part of their plan and to tell us what happens.<\/p>\n

    Sometimes we’ll learn\u00a0that an upcoming project is going to be delivered in a different way, or there’s some tougher evaluation happening around digital.<\/p>\n

    We capture this evidence as the programme progresses.<\/p>\n

     <\/p>\n

    \"Someone<\/a>
    We want to recognise effort in proportion to experience and confidence<\/figcaption><\/figure>\n

    5. Has there been any impact on the organisation?<\/h2>\n

    A surprising and very satisfying outcome from some cohorts has been teams coming together to change a project or working practice, off the back of something they’ve read collectively in their plan.<\/p>\n

    Sometimes this is an improvement, such as reviewing web stats and improving content on a page, other times it’s recognising a problem that needs addressing – most often when participants realise their work devices won’t let them\u00a0access something linked from their plan.<\/p>\n

    We capture this evidence as the programme progresses.<\/p>\n

     <\/p>\n

    As with the rest of the programme, we’re constantly improving our approach to evaluation. We’ll be testing new ideas with each new cohort of participants.<\/p>\n

     <\/p>\n

    Image licenced\u00a0under Creative Commons<\/a>. Attributed\u00a0to JM Fumeau<\/a>.<\/p>\n

     <\/p>","protected":false},"excerpt":{"rendered":"

    We’re often asked: how do you evaluate the Digital Action Plan? Quite rightly, clients\u00a0want to know their learning budget is being put to good use. We don’t (yet) have a fancy evaluation framework, or a standard way of scoring people. This is because: this programme is about confidence as much as skills. Confidence is very […]<\/p>","protected":false},"author":4,"featured_media":22318,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[11],"tags":[219,212],"class_list":["post-782","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog","tag-digital-action-plan","tag-skills-development-learning"],"acf":[],"yoast_head":"\nHelpful Digital - How do we evaluate learning new skills and growing confidence?<\/title>\n<meta name=\"description\" content=\"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/helpfuldigital.com\/fr\/how-we-evaluate-dap\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Helpful Digital - How do we evaluate learning new skills and growing confidence?\" \/>\n<meta property=\"og:description\" content=\"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan\" \/>\n<meta property=\"og:url\" content=\"https:\/\/helpfuldigital.com\/fr\/how-we-evaluate-dap\/\" \/>\n<meta property=\"og:site_name\" content=\"Helpful Digital\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/helpfulhq\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-07-26T14:39:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-06-01T13:30:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-1024x680.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"680\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Tim Lloyd\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@helpfuldigital\" \/>\n<meta name=\"twitter:site\" content=\"@helpfuldigital\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim Lloyd\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/\"},\"author\":{\"name\":\"Tim Lloyd\",\"@id\":\"https:\/\/helpfuldigital.com\/#\/schema\/person\/60fa27810bbbc81590179fa3c788fec0\"},\"headline\":\"How do we evaluate learning new skills and growing confidence?\",\"datePublished\":\"2016-07-26T14:39:39+00:00\",\"dateModified\":\"2020-06-01T13:30:36+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/\"},\"wordCount\":909,\"publisher\":{\"@id\":\"https:\/\/helpfuldigital.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg\",\"keywords\":[\"Digital Action Plan\",\"Skills development and learning\"],\"articleSection\":[\"Blog\"],\"inLanguage\":\"fr-FR\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/\",\"url\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/\",\"name\":\"Helpful Digital - How do we evaluate learning new skills and growing confidence?\",\"isPartOf\":{\"@id\":\"https:\/\/helpfuldigital.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg\",\"datePublished\":\"2016-07-26T14:39:39+00:00\",\"dateModified\":\"2020-06-01T13:30:36+00:00\",\"description\":\"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan\",\"breadcrumb\":{\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage\",\"url\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg\",\"contentUrl\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg\",\"width\":2560,\"height\":1700},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/helpfuldigital.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How do we evaluate learning new skills and growing confidence?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/helpfuldigital.com\/#website\",\"url\":\"https:\/\/helpfuldigital.com\/\",\"name\":\"Helpful Digital\",\"description\":\"Building confidence in a digital world\",\"publisher\":{\"@id\":\"https:\/\/helpfuldigital.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/helpfuldigital.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/helpfuldigital.com\/#organization\",\"name\":\"Helpful Digital\",\"url\":\"https:\/\/helpfuldigital.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/helpfuldigital.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2019\/12\/helpful-h-logo.png\",\"contentUrl\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2019\/12\/helpful-h-logo.png\",\"width\":871,\"height\":869,\"caption\":\"Helpful Digital\"},\"image\":{\"@id\":\"https:\/\/helpfuldigital.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/helpfulhq\/\",\"https:\/\/x.com\/helpfuldigital\",\"https:\/\/instagram.com\/helpfuldigital\",\"https:\/\/www.linkedin.com\/company\/helpful-technology\",\"https:\/\/www.youtube.com\/channel\/UC1zSFtjZqozK0aNd6KryN8g\/featured\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/helpfuldigital.com\/#\/schema\/person\/60fa27810bbbc81590179fa3c788fec0\",\"name\":\"Tim Lloyd\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/helpfuldigital.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2024\/08\/Tim-headshot-96x96.jpg\",\"contentUrl\":\"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2024\/08\/Tim-headshot-96x96.jpg\",\"caption\":\"Tim Lloyd\"},\"url\":\"https:\/\/helpfuldigital.com\/fr\/author\/tim\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Helpful Digital - How do we evaluate learning new skills and growing confidence?","description":"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/helpfuldigital.com\/fr\/how-we-evaluate-dap\/","og_locale":"fr_FR","og_type":"article","og_title":"Helpful Digital - How do we evaluate learning new skills and growing confidence?","og_description":"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan","og_url":"https:\/\/helpfuldigital.com\/fr\/how-we-evaluate-dap\/","og_site_name":"Helpful Digital","article_publisher":"https:\/\/www.facebook.com\/helpfulhq\/","article_published_time":"2016-07-26T14:39:39+00:00","article_modified_time":"2020-06-01T13:30:36+00:00","og_image":[{"width":1024,"height":680,"url":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-1024x680.jpg","type":"image\/jpeg"}],"author":"Tim Lloyd","twitter_card":"summary_large_image","twitter_creator":"@helpfuldigital","twitter_site":"@helpfuldigital","twitter_misc":{"\u00c9crit par":"Tim Lloyd","Dur\u00e9e de lecture estim\u00e9e":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#article","isPartOf":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/"},"author":{"name":"Tim Lloyd","@id":"https:\/\/helpfuldigital.com\/#\/schema\/person\/60fa27810bbbc81590179fa3c788fec0"},"headline":"How do we evaluate learning new skills and growing confidence?","datePublished":"2016-07-26T14:39:39+00:00","dateModified":"2020-06-01T13:30:36+00:00","mainEntityOfPage":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/"},"wordCount":909,"publisher":{"@id":"https:\/\/helpfuldigital.com\/#organization"},"image":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage"},"thumbnailUrl":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg","keywords":["Digital Action Plan","Skills development and learning"],"articleSection":["Blog"],"inLanguage":"fr-FR"},{"@type":"WebPage","@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/","url":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/","name":"Helpful Digital - How do we evaluate learning new skills and growing confidence?","isPartOf":{"@id":"https:\/\/helpfuldigital.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage"},"image":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage"},"thumbnailUrl":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg","datePublished":"2016-07-26T14:39:39+00:00","dateModified":"2020-06-01T13:30:36+00:00","description":"Effort, completion rates, organisational impact and direct feedback are all important factors when we evaluate the Digital Action Plan","breadcrumb":{"@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#primaryimage","url":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg","contentUrl":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2016\/07\/stephan-henning-S0hFspmvm_s-unsplash-scaled.jpg","width":2560,"height":1700},{"@type":"BreadcrumbList","@id":"https:\/\/helpfuldigital.com\/how-we-evaluate-dap\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/helpfuldigital.com\/"},{"@type":"ListItem","position":2,"name":"How do we evaluate learning new skills and growing confidence?"}]},{"@type":"WebSite","@id":"https:\/\/helpfuldigital.com\/#website","url":"https:\/\/helpfuldigital.com\/","name":"Helpful Digital","description":"Building confidence in a digital world","publisher":{"@id":"https:\/\/helpfuldigital.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/helpfuldigital.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/helpfuldigital.com\/#organization","name":"Helpful Digital","url":"https:\/\/helpfuldigital.com\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/helpfuldigital.com\/#\/schema\/logo\/image\/","url":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2019\/12\/helpful-h-logo.png","contentUrl":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2019\/12\/helpful-h-logo.png","width":871,"height":869,"caption":"Helpful Digital"},"image":{"@id":"https:\/\/helpfuldigital.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/helpfulhq\/","https:\/\/x.com\/helpfuldigital","https:\/\/instagram.com\/helpfuldigital","https:\/\/www.linkedin.com\/company\/helpful-technology","https:\/\/www.youtube.com\/channel\/UC1zSFtjZqozK0aNd6KryN8g\/featured"]},{"@type":"Person","@id":"https:\/\/helpfuldigital.com\/#\/schema\/person\/60fa27810bbbc81590179fa3c788fec0","name":"Tim Lloyd","image":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/helpfuldigital.com\/#\/schema\/person\/image\/","url":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2024\/08\/Tim-headshot-96x96.jpg","contentUrl":"https:\/\/helpfuldigital.com\/wp-content\/uploads\/2024\/08\/Tim-headshot-96x96.jpg","caption":"Tim Lloyd"},"url":"https:\/\/helpfuldigital.com\/fr\/author\/tim\/"}]}},"_links":{"self":[{"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/posts\/782","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/comments?post=782"}],"version-history":[{"count":3,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/posts\/782\/revisions"}],"predecessor-version":[{"id":22319,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/posts\/782\/revisions\/22319"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/media\/22318"}],"wp:attachment":[{"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/media?parent=782"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/categories?post=782"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/helpfuldigital.com\/fr\/wp-json\/wp\/v2\/tags?post=782"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}