Hi @FernandoMartins1970, thanks for report. Appsettings.json in description has error in it, i assume that was due to redacting connection strings/paths/etc.?

Can You send me full migration log to email [email protected] or at least version filtered to errors? (if log is large feel free to zip/rar/7z)

appsettings.json:

{
  "Logging": {
    "LogLevel": {
      "Default": "Information",
      "System": "Warning",
      "Microsoft": "Warning"
    },
    "File": {
      "LogLevel": {
        "Default": "Trace",
        "System": "Error",
        "Microsoft": "Error",
        "Microsoft.EntityFrameworkCore": "Information",
        "Migration.Toolkit": "Trace",
        "Kentico.Xperience.UMT": "Trace",
        "Migration.Toolkit.Common.Services.BulkCopy": "Trace"
      },
      // this one
      "pathFormat": "logs/migration.tool.log",
      "OutputTemplate": "{Timestamp:o} ({SourceContext}) [{Level:u3}] {Message} ({EventId:x8}){NewLine}{Exception}"
    }
  },
...

Can You post screen of old page tree vs new page tree? (difference might give me a clue)

Hi @FernandoMartins1970, thanks for report. Appsettings.json in description has error in it, i assume that was due to redacting connection strings/paths/etc.?

Can You send me full migration log to email [email protected] or at least version filtered to errors? (if log is large feel free to zip/rar/7z)

appsettings.json:

{
  "Logging": {
    "LogLevel": {
      "Default": "Information",
      "System": "Warning",
      "Microsoft": "Warning"
    },
    "File": {
      "LogLevel": {
        "Default": "Trace",
        "System": "Error",
        "Microsoft": "Error",
        "Microsoft.EntityFrameworkCore": "Information",
        "Migration.Toolkit": "Trace",
        "Kentico.Xperience.UMT": "Trace",
        "Migration.Toolkit.Common.Services.BulkCopy": "Trace"
      },
      // this one
      "pathFormat": "logs/migration.tool.log",
      "OutputTemplate": "{Timestamp:o} ({SourceContext}) [{Level:u3}] {Message} ({EventId:x8}){NewLine}{Exception}"
    }
  },
...

Can You post screen of old page tree vs new page tree? (difference might give me a clue)

Hi @FernandoMartins1970, thanks for report. Appsettings.json in description has error in it, i assume that was due to redacting connection strings/paths/etc.?

Can You send me full migration log to email [email protected] or at least version filtered to errors? (if log is large feel free to zip/rar/7z)

appsettings.json:

{
  "Logging": {
    "LogLevel": {
      "Default": "Information",
      "System": "Warning",
      "Microsoft": "Warning"
    },
    "File": {
      "LogLevel": {
        "Default": "Trace",
        "System": "Error",
        "Microsoft": "Error",
        "Microsoft.EntityFrameworkCore": "Information",
        "Migration.Toolkit": "Trace",
        "Kentico.Xperience.UMT": "Trace",
        "Migration.Toolkit.Common.Services.BulkCopy": "Trace"
      },
      // this one
      "pathFormat": "logs/migration.tool.log",
      "OutputTemplate": "{Timestamp:o} ({SourceContext}) [{Level:u3}] {Message} ({EventId:x8}){NewLine}{Exception}"
    }
  },
...

Can You post screen of old page tree vs new page tree? (difference might give me a clue)

Hi @tkrch
I have sent to you the complete json and log files. I removed the credentials in Json above because had password there. I am sending here without the credentials.

{
"Logging": {
"LogLevel": {
"Default": "Information",
"System": "Warning",
"Microsoft": "Warning"
},
"File": {
"LogLevel": {
"Default": "Information",
"System": "Warning",
"Microsoft": "Warning"
},
"pathFormat": "logs/migration.tool.log",
"OutputTemplate": "{Timestamp:o} ({SourceContext}) [{Level:u3}] {Message} ({EventId:x8}){NewLine}{Exception}"
}
},
"Settings": {
"KxConnectionString": "Data Source=;Initial Catalog=13Mvc;Integrated Security=False;Persist Security Info=False;User ID=;Password=;Connect Timeout=60;Encrypt=False;Current Language=English;",
"KxCmsDirPath": "C:\Inorbital\Code\Inorbital\CMS",
"XbKDirPath": "C:\Inorbital\Code\InorbitalXbyK",
"XbKApiSettings": {
"ConnectionStrings": {
"CMSConnectionString": "Data Source=**********;Initial Catalog=XbyK_Db;Integrated Security=True;Persist Security Info=False;Connect Timeout=60;Encrypt=False;Current Language=English;"
}
},
"MigrateOnlyMediaFileInfo": false,
"MigrateMediaToMediaLibrary": true,
"UseDeprecatedFolderPageType": false,
"CreateReusableFieldSchemaForClasses": "",
"FieldMigrations": {
"SourceDataType": "text",
"TargetDataType": "assets",
"SourceFormControl": "MediaSelectionControl",
"TargetFormComponent": "Kentico.Administration.AssetSelector",
"Actions": [ "convert to asset" ],
"FieldNameRegex": "."
},
"UseOmActivityNodeRelationAutofix": "AttemptFix",
"UseOmActivitySiteRelationAutofix": "AttemptFix",
"EntityConfigurations": {
"CMS_Class": {
"ExcludeCodeNames": []
},
"CMS_SettingsKey": {
"ExcludeCodeNames": []
}
},
"MemberIncludeUserSystemFields": "FirstName|MiddleName|LastName|FullName|UserPassword|PreferredCultureCode|PreferredUICultureCode|UserPrivilegeLevel|UserIsExternal|UserPasswordFormat|LastLogon|UserStartingAliasPath|UserLastModified|UserLastLogonInfo|UserIsHidden|UserIsDomain|UserHasAllowedCultures|UserMFRequired|UserMFSecret|UserMFTimestep|UserNickName|UserSignature|UserURLReferrer|UserCampaign|UserCustomData|UserRegistrationInfo|UserActivationDate|UserActivatedByUserID|UserTimeZoneID|UserAvatarID|UserGender|UserDateOfBirth|UserSettingsUserGUID|UserSettingsUserID|UserWaitingForApproval|UserDialogsConfiguration|UserDescription|UserAuthenticationGUID|UserSkype|UserIM|UserPhone|UserPosition|UserLogActivities|UserPasswordRequestHash|UserInvalidLogOnAttempts|UserInvalidLogOnAttemptsHash|UserPasswordLastChanged|UserAccountLockReason|UserShowIntroductionTile|UserDashboardApplications|UserDismissedSmartTips"
}
}

Hi @FernandoMartins1970, email reached me, after log review:

i couldn't see any trace or debug entries in log (only warnings, errors, info), i have sent You update appsettings.json through email.

I highly recommend to setup Source instance API discovery

errors like this: Cannot migrate url for document '2' / node '2', source instance context is not available or set-up correctly will be solved.

Please check setting Settings.KxCmsDirPath it seems like MT fails to find images. You can check where MT search for image by log review and search for "Suggestion: If you have a backup, copy it to the filesystem on path"

With trace log i will see what is happening.

Hi,

Just dropping in to comment, that the inverse of allowing pages to be transformed into widgets is a use-case I've come across previously.

@FernandoMartins1970 email received, but i can't see any logs attached. If logfiles are too big, can you upload logfiles somewhere i can reach them?

1. You need to configure Source instance API discovery in order to solve error Cannot migrate url for document '2' / node '2', source instance context is not available or set-up correctly will be solved. otherwise, migration tool cannot migrate full url without information loss
2. in order to solve this error i need to know form control that was used for value input and other information stored in Trace log
3. weird, but from trace log (when i receive it) I can see why widgets were migrated as pages

other way is to share anonymized/sanitized database and i will run migration to see what happens exactly.

@Sapphirress do we have any place where logfiles/database can be safely uploaded?

@FernandoMartins1970 confirmed, logs in correct verbosity received

@FernandoMartins1970 i will look into it today

@FernandoMartins1970 i managed to successfully simulate some issue and working on fix. I will notify when fix preview is available

@FernandoMartins1970 can you try migration with git branch fix/302_issues (PR #309), delete old log, record new log and send log to me? I will check if expected improvements occurred.

Thanks for additional tests @FernandoMartins1970, i will try to continue with analysis as soon as possible.

@FernandoMartins1970 for further investigation we would need your backups.

Could you please share your email so I can send you instructions where/how to upload them?

Thanks!

Lukáš

Good morning Lucas and Thomás.

Do you have any update about this issue?

Hi, FernandoMartins1970
We already have the database, and we are looking for a solution. We will inform you about the next steps.

Hi @FernandoMartins1970, You may try #334 before it gets pulled into release.
Few notes on migration:

• in supplied db, there are missing binaries for attachments, column AttachmentBinary is null for some => partially fixed, now error doesn't stop content item from migration
• in supplied db, image ~/INO/media/Images/Inorbital.png for example wasn't migrated due to media library setup => this was fixed
• some images have unescaped unicode characters in them, for example – (en dash U+2013), migration tool is now more forgiving and accepts such urls => issue fixed
• some images cannot be found on filesystem - they will still show errors
• some images are stored in azure blob storage, they have to be remapped to filesystem and direct links to them have to be converted (this capability is not supported in migration tool - feature request), theses images will cause errors in target XbyK instance in administration
• tree migration should be fixed in this instance

@liparova FYI

Hello Thomas

The branch 334 was not found.

[cid:dfa8c9aa-b6a2-4bfb-ac7d-32e5cbda133e]

Fernando Martins

Web Developer

www.inorbital.com<http://www.inorbital.com/>

[cid:800a0788-fc32-49c9-a678-140dc38fbce3]
…

Seems to be this one per the pull request 302_various_fixes_and_less_strict_media_migration

try this url - should be accessible. #334